Hello! I’m confused about the usage of dbt in this scenario. I need to extract data from a transactional data source and model it in a star schema for inclusion in a data warehouse. My question is, is the only way to update this table by using incremental loading with dbt? I see many people using a full refresh strategy, but if I do a full refresh, I lose my historical data or dbt saves it in a temp table and load it again?
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Need help with the Incremental | 1 | 973 | December 18, 2023 | |
Loading the transactional data as snapshot using dbt modelling | 0 | 576 | November 16, 2023 | |
Modeling existing multistep ETL process | 0 | 541 | February 6, 2024 | |
Is dbt an ETL tool? | 7 | 5302 | August 24, 2018 | |
Could DBT be used to migrate data between operational databases? | 6 | 13638 | June 11, 2020 |