When I group or perform certain transformations from one table to another, is it possible to get a summary of that? For example, when I run dbt run
and I have a view A with 1 million observations in the intermediate layer, and I create a table in the mart layer that groups view A by certain features, resulting in a table with 10k observations, I’d like to see:
- The size reduction in observations: from 1 million to 10k.
- The number and percentage of null values for certain features.
Would it be possible to see this in the DAG visualization? If not, how would you implement this? I want to use these summaries as a quick general overview of how the data is being processed and transformed across the layers.