Hi community,
I’m trying to figure out a few things with dbt.
The background here is that my company is using dbt with airflow and cosmos with databricks.
We’re mixing dbt with a home-grown solution. what I meant, is that: table is managed by the home grown solutions, but the logic lives in dbt.
Additionally, users run dbt locally, which is connected to a development environment, and once shipped, dbt gets run in an airflow.
Since dbt can already create and update tables, I think we rely on dbt rather than our home-grown solutions. However, there are a few things that I’d like to check:
- We need to add additional informations to a table, for example: table classifications - for FGAC, internal id for the table, and policies that need to be attached to it. Is there a way to specify these in the model yaml file?
- Is there a strongly typed yaml parser sdk?
- How does dbt deal with a table rename? If one renames the model, does dbt
- It seems that dbt doesn’t drop tables. Is there plan to deal with this?