We test all (probably really most) of our views and tables that sit in our analytics schema, which is all the data that is deemed to be ready for use.
We currently don’t have much testing on downstream models that aren’t materialised, particularly ‘base’ ephemeral models that have no joins and effectively just cleans up the individual raw tables. We’ve started doing it, which has massively increased the number of tests of project has (>1000), and I wanted to know what people’s views on this are.
It’s starting to take much longer for the tests to run as well. We currently run tests after each production refresh of the tables, which may not be necessary.
- Do you test all your ephemeral/down-stream models?
- Do people have a specific setup with all of this?
- Is there a best practice?