The problem I’m having
The context of why I’m trying to do this
I’d like to ask about a script dbt merge job.
Currently, I’m running dbt build --full-refresh --select state:modified+
However, I’d like to be specific on the databases or schemas. For example, the tables under staging folder are run under the REPORTING database. Meanwhile, the tables under staging_realtime folder are run under the CLIENT_REPORTING database.
I’m planning to run the merge job only for staging_realtime . Therefore, only the tables under staging_realtime directory trigger the merge job. The tables under staging should not trigger the merge job. Does anybody know the script that can execute what I need as explained above?
What I’ve already tried
I have set a merge job with the following code
dbt build --full-refresh --select state:modified+
Some example code or error messages
Database Error in model mrt_concord_evolution_contract_types (models/mart/intermediate/mrt_concord_evolution_contract_types.sql)
002003 (42S02): SQL compilation error:
Object 'STAGING_CLIENT_REPORTING.MAPPINGS.MODULES' does not exist or not authorized.
In this case, MAPPINGS.MODULES
is indeed not available in STAGING_CLIENT_REPORTING
database. Therefore, I want to exclude MAPPINGS.MODULES in the merge job.