I have a incremental model for bigquery with insert_overwrite strategy. I am trying to implement time_ingestion_partitioning with copy_partitions enabled for cost saving. But I am getting following error:
01:42:00 BigQuery adapter: Copying table(s) “/projects/my-project/datasets/my-dataset/tables/my-model__dbt_tmp$20240712” to “/projects/my-project/datasets/my-dataset/tables/my-model$20240712” with disposition: “WRITE_TRUNCATE”
01:42:01 BigQuery adapter: Retry attempt 1 of 1 after error: BadRequest(‘Failed to copy Natural partitioned meta table to Column partitioned meta table: incompatible partitions.’)
I am trying to understand what could be wrong here? I could not find the log mentioned anywhere while googling.
I was following this blog BigQuery ingestion-time partitioning and partition copy with dbt | dbt Developer Blog