The problem I’m having
I have a table where we report metrics that is generated through the dbt_metrics package and contains more than 100 million rows in a day granularity, so in many occasions the execution fails.
The context of why I’m trying to do this
Running the job with the model.
What I’ve already tried
I am trying to find out if there is any option of changing the model to incremental but dbt_metrics, unless I’m mistaken, does not contain any parameter to do it. I would like to know if anyone has encountered this problem before and see possible options to solve it.
Some example code or error messages
Query (268807711) cancelled by WLM abort action of Query Monitoring Rule “LongQueryDefaultAbort”.