I am configuring my incremental model to add new columns to the model without a full refresh. I am getting an error ‘invalid identifier column’. Note that these model are written in Snowflake through dbt. I am using on_schema_change=‘sync_all_columns’ in the configs.
what i basically want is the incremental model to run without a full refresh and append and drop columns automatically, for new columns the historical values can be blank but the new values should populate
I am using the following configs in the .yml and .sql files respectively:
name: audit_table
description: >
'some description and context'
config:
on_schema_change: "sync_all_columns"
columns:
- name: col
Hi,
I have a similar issue, I work with dbt core in combination with MS SQL Server. I get an ‘invalid column name’ when I run my model that has on_schema_change=‘sync_all_columns’ in the configs. It seems that the syncing just does not take place.
Unfortunately I also did not find a solution yet. Does this maybe only work with dbt cloud?
Happy for input. Thank you!