I want to load high number of transactional record set as snapshot through dbt.
The context of why I’m trying to do this:
We have Business use case where we want to maintain the changes to transactional data in time.
So we would want to track the changes to transactions by unique id overtime.
We are suspicious that dbt will be able to handle high number of records to check daily for changes.
So we are thinking of strategy as how do we solve this.
can experts help in this ?