The problem I’m having
I’m using dbt CLI for data transformations in BigQuery, and I’m encountering an issue with how datasets are named after transformations. When I specify a dataset during project initialization (e.g., ‘abc’), the transformation results are being loaded with an unintended naming pattern in BigQuery. The name ends up being something like ‘abc_silver_abc’, instead of just the intended ‘silver_abc’.
The context of why I’m trying to do this
I want to load my transformation results into a dataset I created, such as ‘silver_abc’, without dbt appending the original dataset name (e.g., ‘abc’) to it.
I’ve configured the SQL file to overwrite the data and tried specifying the desired schema, but the issue persists.
{{ config(
materialized='table',
schema='silver_abc',
) }}
Despite the configuration, the dataset in BigQuery is being named ‘abc_silver_abc’.