How to change location dynamically ? or how to query cross region data ?
I’m using dbt Cloud with BigQuery as my data warehouse. My dbt Cloud environment is configured to run in the EU multi-region, but I’m trying to use a public dataset:
SELECT * FROM dbt-tutorial.stripe.payment
This dataset is located in the US multi-region, and I’m getting the following error:
Not found: Dataset dbt-tutorial:stripe was not found in location EU
What I’ve Tried:
Verified that my dbt Cloud environment is set to EU.
Tried to define the source in sources.yml, but I understand that BigQuery location can’t be set there.
I’d prefer not to switch my dbt Cloud environment to US, since my main data is in EU.