DBT with Unity Catalog - Failing to perform Incremental Materialization

Help
,
1

HI all,

We are using DataBricks with Unity Catalog and we observe a peculiar issue with the Incremental Materailization. This Materialization is not working as expected, it behaves as table Materialization rather than Append, we tried all the options mentioned as per the documentation Apache Spark configurations | dbt Developer Hub. can you please check let us know if this a know issue or a config gap I am doing ?

dbt Versions:
Core: 1.3.2
databricks: 1.3.2
Spark: 1.3.0

Profile:

dbt_databricks:
  outputs:
    dev:
      catalog: 'hive_metastore'
      host: adb-99999999999999.azuredatabricks.net
      http_path: sql/protocolv1/o/99999999999999/9999-999999
      schema: 'jaffle_shop'
      threads: 1
      token: XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
      type: databricks
  target: dev

Model Config:

1. {{ config(
    materialized='incremental',
    incremental_strategy='append',
) }}

2. {{ config(
    materialized='incremental',
    file_format='delta',
    unique_key='copa_unique_key',
    incremental_strategy='merge'
) }}