How to run dbt on Cloud Composer and authenticate the service account

Help
, ,
2

Hi Giorgos,

We run dbt via “GKEStartPodOperator” on Cloud Composer. We can then leverage workload identity of the service account running the node pool. This has the benefit of separating the scheduling of Airlfow from the execution of dbt that will be on a separate node pool. And also no need anymore to create a json key for the service account.

Best regards,

Charles

1 Like