What is the best practice for deploying Airflow together with dbt?

In-Depth Discussions
,
2

A solid implementation used by many community members is to use Docker, K8 Operator and Airflow.

At a high level, the steps to do so are:

  1. Build, tag and push an image with the most recent version of your dbt project on each of your deployments
  2. Use the Kubernetes Operator for all tasks in Airflow that run dbt
  3. Have the K8 Operator pull and run the latest tagged image, with the relevant dbt command
2 Likes