Snapshots not automatically adding new column to snapshot table in databricks
Docs indicate this should happen automatically
FAQ on adding a new column to schema: What happens if I add new columns to my snapshot query? | dbt Developer Hub
What I’ve already tried
If I manually add the new column to the snapshot table, dbt snapshot works. I’ve also tried changing the strategy to timestamp, but the same error occurs
yml definition for the snapshot in question
snapshots:
- name: case_snapshot
relation: ref('ephemeral_monolith_cases') #data type transformation in the ephemeral model #source('monolith', 'case')
description: Historisierung von case
config:
schema: snapshots
catalog: "{{env_var('DBT_ENV_NAME') ~ '_domain_dwh'}}"
unique_key: cse_app_id
strategy: check #timestamp
check_cols: all
#updated_at: cse_changed_date
hard_deletes: new_record
#pre_hook: "Select * from "
# dbt_valid_to_current: "to_date('9999-12-31')" # Specifies that current records should have `dbt_valid_to` set to `'9999-12-31'` instead of `NULL`.