Hello! I’m confused about the usage of dbt in this scenario. I need to extract data from a transactional data source and model it in a star schema for inclusion in a data warehouse. My question is, is the only way to update this table by using incremental loading with dbt? I see many people using a full refresh strategy, but if I do a full refresh, I lose my historical data or dbt saves it in a temp table and load it again?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Snowflake Streams for incremental dbt loads | 0 | 3873 | June 21, 2022 | |
| Modeling existing multistep ETL process | 0 | 623 | February 6, 2024 | |
| Incremental model runs only like "create or replace table..." | 6 | 4491 | October 24, 2023 | |
| Is dbt an ETL tool? | 7 | 5692 | August 24, 2018 | |
| Partial full refresh of the incremental tables | 2 | 1343 | February 13, 2024 |