The problem I’m having
The challenge we are running into is that if we wanted to run the source_status:fresher+ command in our prod job, we should have defined freshness block in all of our source tables in order to make sure if any model’s data has updated then it gets built upon.
The context of why I’m trying to do this
Why we don’t want to have warning on all those is because there are many very slow moving models (21 models haven’t updated in last 365 days) so our list of source tables under the warn will be huge and we might end up ignoring it and no real use.
What I’ve already tried
For now, I have defined freshness at the schema level with warning (and no error) if older than 365 days so that applies to all of the source tables but the ones where we really need to make sure they are updated and specified it’s own freshness block for individual tables (with warn and error).