# \#incremental

**URL:** https://discourse.getdbt.com/tag/incremental/18.md

[Latest](https://discourse.getdbt.com/latest.md) · [Categories](https://discourse.getdbt.com/categories.md) · [Tags](https://discourse.getdbt.com/tags.md)

---

## [Prevent accidental replacement of production tables while allowing dbt-managed schema evolution](https://discourse.getdbt.com/t/prevent-accidental-replacement-of-production-tables-while-allowing-dbt-managed-schema-evolution/20903)

<div class="topic-metadata">

**Author:** [@MichalR](https://discourse.getdbt.com/u/MichalR)\
**Replies:** 0\
**Last updated:** [July 27, 2026, 3:00pm UTC](https://discourse.getdbt.com/t/prevent-accidental-replacement-of-production-tables-while-allowing-dbt-managed-schema-evolution/20903 "2026-07-27T15:00:59Z")

</div>

We had an incremental model using the delete+insert strategy. Instead of updating the existing production table, dbt treated it as missing, followed its initial-creation path, and replaced it with an empty table. Overri…

---

## [Snowflake Streams with DBT](https://discourse.getdbt.com/t/snowflake-streams-with-dbt/8314)

<div class="topic-metadata">

**Author:** [@os15](https://discourse.getdbt.com/u/os15)\
**Replies:** 8\
**Last updated:** [February 23, 2026, 8:47am UTC](https://discourse.getdbt.com/t/snowflake-streams-with-dbt/8314 "2026-02-23T08:47:03Z")

</div>

Hi, We are in the process of assessing our orchestration tool for modelling within in Snowflake. I have used Snowflake and dbt in the past together but couldn’t find a way to leverage the two and their strengths togeth…

---

## [Incremental logic implementation in dbt core from databricks](https://discourse.getdbt.com/t/incremental-logic-implementation-in-dbt-core-from-databricks/20516)

<div class="topic-metadata">

**Author:** [@Rajmohan](https://discourse.getdbt.com/u/Rajmohan)\
**Replies:** 0\
**Last updated:** [January 5, 2026, 9:43am UTC](https://discourse.getdbt.com/t/incremental-logic-implementation-in-dbt-core-from-databricks/20516 "2026-01-05T09:43:25Z")

</div>

While we are trying to use incremental materialization in dbt with databricks local which is required for the creation of incremental models and custom scd logic. Internally dbt is trying to read metadata for increment…

---

## [Change Snowflake warehouse when full-refresh or incremental run](https://discourse.getdbt.com/t/change-snowflake-warehouse-when-full-refresh-or-incremental-run/20450)

<div class="topic-metadata">

**Author:** [@adrimoo](https://discourse.getdbt.com/u/adrimoo)\
**Replies:** 3\
**Last updated:** [November 24, 2025, 8:02pm UTC](https://discourse.getdbt.com/t/change-snowflake-warehouse-when-full-refresh-or-incremental-run/20450 "2025-11-24T20:02:53Z")

</div>

Hi, We’re trying to set up our dbt Core project so that an individual incremental model can be configured to run with different Snowflake Warehouses depending on whether it’s running in a full-refresh, or an incremental…

---

## [How to prevent partial read in dbt](https://discourse.getdbt.com/t/how-to-prevent-partial-read-in-dbt/20404)

<div class="topic-metadata">

**Author:** [@michaelkm](https://discourse.getdbt.com/u/michaelkm)\
**Replies:** 0\
**Last updated:** [November 6, 2025, 2:30am UTC](https://discourse.getdbt.com/t/how-to-prevent-partial-read-in-dbt/20404 "2025-11-06T02:30:42Z")

</div>

The problem I’m having How can I prevent partial or inconsistent reads in dbt when transforming data from a source system that only supports READ COMMITTED isolation level? The context of why I’m trying to do this I am …

---

## [How to apply column-level constraints to incremental models without full-refresh?](https://discourse.getdbt.com/t/how-to-apply-column-level-constraints-to-incremental-models-without-full-refresh/20394)

<div class="topic-metadata">

**Author:** [@tl-jacob](https://discourse.getdbt.com/u/tl-jacob)\
**Replies:** 1\
**Last updated:** [November 4, 2025, 1:24am UTC](https://discourse.getdbt.com/t/how-to-apply-column-level-constraints-to-incremental-models-without-full-refresh/20394 "2025-11-04T01:24:03Z")

</div>

The problem I’m having I have an incremental model materialized as a table with column-level constraints defined in my schema.yml: models: - name: my\_incremental\_model config: contract: enforced: tru…

---

## [2 step processing of streaming data with dbt incrementals](https://discourse.getdbt.com/t/2-step-processing-of-streaming-data-with-dbt-incrementals/20358)

<div class="topic-metadata">

**Author:** [@mate](https://discourse.getdbt.com/u/mate)\
**Replies:** 1\
**Last updated:** [October 27, 2025, 5:31pm UTC](https://discourse.getdbt.com/t/2-step-processing-of-streaming-data-with-dbt-incrementals/20358 "2025-10-27T17:31:59Z")

</div>

Hello dbt Community, I want process streaming data with dbt incremental models in two steps. The data comes from a Kafka Topic and is loaded into a Snowflake Database (via Snowpipe Streaming). The table (R1) holds the r…

---

## [Partitions lost during SQL-view (GA4 package)](https://discourse.getdbt.com/t/partitions-lost-during-sql-view-ga4-package/20201)

<div class="topic-metadata">

**Author:** [@bart\_kd](https://discourse.getdbt.com/u/bart_kd)\
**Replies:** 0\
**Last updated:** [September 5, 2025, 2:37pm UTC](https://discourse.getdbt.com/t/partitions-lost-during-sql-view-ga4-package/20201 "2025-09-05T14:37:07Z")

</div>

The problem I’m having I’m using the GA4-package (Velir) in dbt to transform al the GA4-data in my BigQuery Warehouse. However, the view called ‘stg\_ga4\_\_events.sql’ seems unable to use the partitions that are available …

---

## [Best Practices for Robust, Idempotent Incremental Models (Beyond Timestamps)](https://discourse.getdbt.com/t/best-practices-for-robust-idempotent-incremental-models-beyond-timestamps/20200)

<div class="topic-metadata">

**Author:** [@binhln](https://discourse.getdbt.com/u/binhln)\
**Replies:** 0\
**Last updated:** [September 5, 2025, 10:28am UTC](https://discourse.getdbt.com/t/best-practices-for-robust-idempotent-incremental-models-beyond-timestamps/20200 "2025-09-05T10:28:49Z")

</div>

Hello dbt Community! I’m working on designing a near real-time pipeline and want to ensure our dbt incremental models are as robust as possible. My background is in stream processing with tools like Spark Streaming, wh…

---

## [Concurrent dbt runs](https://discourse.getdbt.com/t/concurrent-dbt-runs/11101)

<div class="topic-metadata">

**Author:** [@siddharth.bose](https://discourse.getdbt.com/u/siddharth.bose)\
**Replies:** 2\
**Last updated:** [August 20, 2025, 3:19pm UTC](https://discourse.getdbt.com/t/concurrent-dbt-runs/11101 "2025-08-20T15:19:10Z")

</div>

We use airflow to orchestrate our dbt runs. Currently we have our entire pipeline run once a day. Though, we have requests to increase the frequency of the runs up to once every 15 mins for parts of the pipeline. My qu…

---

## [Enable query optimizer hotfixes in dbt model](https://discourse.getdbt.com/t/enable-query-optimizer-hotfixes-in-dbt-model/20073)

<div class="topic-metadata">

**Author:** [@tea](https://discourse.getdbt.com/u/tea)\
**Replies:** 1\
**Last updated:** [August 13, 2025, 6:03am UTC](https://discourse.getdbt.com/t/enable-query-optimizer-hotfixes-in-dbt-model/20073 "2025-08-13T06:03:44Z")

</div>

The problem I’m having I am trying to migrate code from at stored procedure in T-SQL to an incremental dbt model. In the stored procedure, we are using OPTION (USE HINT (‘ENABLE\_QUERY\_OPTIMIZER\_HOTFIXES’)) in order to…

---

## [dbt microbatch strategy generating duplicates](https://discourse.getdbt.com/t/dbt-microbatch-strategy-generating-duplicates/20032)

<div class="topic-metadata">

**Author:** [@timothy430](https://discourse.getdbt.com/u/timothy430)\
**Replies:** 2\
**Last updated:** [August 7, 2025, 3:12am UTC](https://discourse.getdbt.com/t/dbt-microbatch-strategy-generating-duplicates/20032 "2025-08-07T03:12:19Z")

</div>

The problem I’m having I am trying to set up a microbatch incremental strategy with a simple model, but I am unsure why duplicate rows are being generated despite configuring unique\_keys. Here is the sample seed data: \_…

---

## [Get batch\_start\_time and batch\_end\_time as jinja vars (Snowflake core)](https://discourse.getdbt.com/t/get-batch-start-time-and-batch-end-time-as-jinja-vars-snowflake-core/19831)

<div class="topic-metadata">

**Author:** [@Liam.McELhaney122](https://discourse.getdbt.com/u/Liam.McELhaney122)\
**Replies:** 0\
**Last updated:** [July 11, 2025, 5:30pm UTC](https://discourse.getdbt.com/t/get-batch-start-time-and-batch-end-time-as-jinja-vars-snowflake-core/19831 "2025-07-11T17:30:21Z")

</div>

The problem I’m having I need to create a date spline from the batch start to to the batch end per batch The context of why I’m trying to do this I am working on a model that does per second calculations, we need to do …

---

## [Incremental model depends on union all view](https://discourse.getdbt.com/t/incremental-model-depends-on-union-all-view/13338)

<div class="topic-metadata">

**Author:** [@jomic](https://discourse.getdbt.com/u/jomic)\
**Replies:** 1\
**Last updated:** [July 3, 2025, 12:49pm UTC](https://discourse.getdbt.com/t/incremental-model-depends-on-union-all-view/13338 "2025-07-03T12:49:37Z")

</div>

The problem I’m having I am trying to run an incremental model which refers to non-incremental views upstream and it seems to be always running a full refresh - hence taking a long time to run. The context of why I’m tr…

---

## [Handling SCD Type 2 Using DBT Incremental Process](https://discourse.getdbt.com/t/handling-scd-type-2-using-dbt-incremental-process/19326)

<div class="topic-metadata">

**Author:** [@dataengineer](https://discourse.getdbt.com/u/dataengineer)\
**Replies:** 1\
**Last updated:** [July 2, 2025, 1:00pm UTC](https://discourse.getdbt.com/t/handling-scd-type-2-using-dbt-incremental-process/19326 "2025-07-02T13:00:48Z")

</div>

I’m working on creating dbt models with the materialization set to incremental. During the initial load, the data is processed correctly. However, on subsequent runs, if there are changes in the source data for the same …

---

## [Postgres Adapter incremental strategy delete+insert is not deleting rows](https://discourse.getdbt.com/t/postgres-adapter-incremental-strategy-delete-insert-is-not-deleting-rows/9230)

<div class="topic-metadata">

**Author:** [@mailshuvajit](https://discourse.getdbt.com/u/mailshuvajit)\
**Replies:** 1\
**Last updated:** [June 2, 2025, 1:56pm UTC](https://discourse.getdbt.com/t/postgres-adapter-incremental-strategy-delete-insert-is-not-deleting-rows/9230 "2025-06-02T13:56:36Z")

</div>

The problem I’m having: dbt incremental model is not able to delete row in target table The context of why I’m trying to do this: Trying to implement a SCD Type1 implementation. I have underlying Hub/satelite tables and …

---

## [Change schema on an incremental model](https://discourse.getdbt.com/t/change-schema-on-an-incremental-model/19574)

<div class="topic-metadata">

**Author:** [@achrys0](https://discourse.getdbt.com/u/achrys0)\
**Replies:** 1\
**Last updated:** [June 2, 2025, 3:29am UTC](https://discourse.getdbt.com/t/change-schema-on-an-incremental-model/19574 "2025-06-02T03:29:41Z")

</div>

Hello everyone, I have a question. I built an incremental model, and we’ve decided that a certain column is no longer needed, so we want to remove it. I understand that this will change the schema, which may lead to an …

---

## [How are changes in data types handled in incremental models?](https://discourse.getdbt.com/t/how-are-changes-in-data-types-handled-in-incremental-models/19494)

<div class="topic-metadata">

**Author:** [@MagnusKling](https://discourse.getdbt.com/u/MagnusKling)\
**Replies:** 0\
**Last updated:** [May 23, 2025, 10:59am UTC](https://discourse.getdbt.com/t/how-are-changes-in-data-types-handled-in-incremental-models/19494 "2025-05-23T10:59:57Z")

</div>

The problem I’m having How can we control updates of the incremental model to ensure that any changes in data type in individual fields are not automatically propagated to the incremental model? The context of why I’m t…

---

## [using historic data from a target incremental table as part of a build](https://discourse.getdbt.com/t/using-historic-data-from-a-target-incremental-table-as-part-of-a-build/19375)

<div class="topic-metadata">

**Author:** [@proetman](https://discourse.getdbt.com/u/proetman)\
**Replies:** 1\
**Last updated:** [May 14, 2025, 12:34pm UTC](https://discourse.getdbt.com/t/using-historic-data-from-a-target-incremental-table-as-part-of-a-build/19375 "2025-05-14T12:34:55Z")

</div>

TABLE\_A -------\> TABLE\_B-------\>TARGET (new partition) (historic partition)

---

## [Complex Model Advice](https://discourse.getdbt.com/t/complex-model-advice/19368)

<div class="topic-metadata">

**Author:** [@Erspar](https://discourse.getdbt.com/u/Erspar)\
**Replies:** 0\
**Last updated:** [May 13, 2025, 4:55pm UTC](https://discourse.getdbt.com/t/complex-model-advice/19368 "2025-05-13T16:55:51Z")

</div>

I have a huge curated model that consists of billions of rows. It requires joining 5 other equally huge tables and implementing complex calculations to get a complete picture on the one topic. I’ve set this up in an incr…

---

## [I want to pass a parameter value to a SQL Dbt model](https://discourse.getdbt.com/t/i-want-to-pass-a-parameter-value-to-a-sql-dbt-model/19340)

<div class="topic-metadata">

**Author:** [@hisham2799](https://discourse.getdbt.com/u/hisham2799)\
**Replies:** 3\
**Last updated:** [May 11, 2025, 7:08am UTC](https://discourse.getdbt.com/t/i-want-to-pass-a-parameter-value-to-a-sql-dbt-model/19340 "2025-05-11T07:08:24Z")

</div>

I am running an incremental load for a dataset where I have to filter data based on months, the requirement is to pass the month dynamically to the model so that it can filter the data or else it takes the maximum or lat…

---

## [doing sequential operation in an incremental table](https://discourse.getdbt.com/t/doing-sequential-operation-in-an-incremental-table/19321)

<div class="topic-metadata">

**Author:** [@abdullahwasay](https://discourse.getdbt.com/u/abdullahwasay)\
**Replies:** 0\
**Last updated:** [May 9, 2025, 12:46am UTC](https://discourse.getdbt.com/t/doing-sequential-operation-in-an-incremental-table/19321 "2025-05-09T00:46:24Z")

</div>

The problem I’m having I want to perform sequential operation on the final\_target table from multiple snowflake tables. This means in the end I want to have the table name ‘final\_table’ created if not already created an…

---

## [starrocks microbatch strategy not working](https://discourse.getdbt.com/t/starrocks-microbatch-strategy-not-working/19168)

<div class="topic-metadata">

**Author:** [@khoramism](https://discourse.getdbt.com/u/khoramism)\
**Replies:** 1\
**Last updated:** [April 26, 2025, 3:27pm UTC](https://discourse.getdbt.com/t/starrocks-microbatch-strategy-not-working/19168 "2025-04-26T15:27:03Z")

</div>

hey everyone, hope you guys are having fun. in our company we are planning to create a medallion based architecture, we’ve been storing the bronze layer in iceberg for a while now and we are planning to store our silver…

---

## [Inventory Snapshot Comparison Best Practice](https://discourse.getdbt.com/t/inventory-snapshot-comparison-best-practice/19069)

<div class="topic-metadata">

**Author:** [@np\_qube](https://discourse.getdbt.com/u/np_qube)\
**Replies:** 0\
**Last updated:** [April 17, 2025, 5:09am UTC](https://discourse.getdbt.com/t/inventory-snapshot-comparison-best-practice/19069 "2025-04-17T05:09:38Z")

</div>

Hi everyone :waving\_hand:, I’m currently working on an inventory management reporting pipeline using dbt, and I’m exploring the best practice approach for point-in-time inventory tracking and comparison across multiple …

---

## [All incremental models started failing yesterday](https://discourse.getdbt.com/t/all-incremental-models-started-failing-yesterday/18896)

<div class="topic-metadata">

**Author:** [@NoOne](https://discourse.getdbt.com/u/NoOne)\
**Replies:** 2\
**Last updated:** [April 2, 2025, 3:59pm UTC](https://discourse.getdbt.com/t/all-incremental-models-started-failing-yesterday/18896 "2025-04-02T15:59:56Z")

</div>

Yesterday around 9AM pacific. All of our Incremental models started failing with a message of “syntax error at or near “as” in context” Our incremental models use delete+insert (default). Since all of our models in prod,…

---

## [Incremental model (Merge) without update part 2](https://discourse.getdbt.com/t/incremental-model-merge-without-update-part-2/18849)

<div class="topic-metadata">

**Author:** [@anatoliy4041](https://discourse.getdbt.com/u/anatoliy4041)\
**Replies:** 0\
**Last updated:** [March 28, 2025, 1:45pm UTC](https://discourse.getdbt.com/t/incremental-model-merge-without-update-part-2/18849 "2025-03-28T13:45:21Z")

</div>

Hi, I would like to revisit a previously discussed question: incremental model (Merge) without update. It seems the topic was closed, but I think it was somewhat overlooked. The solution mentioned by joellabes with the N…

---

## [Change the tmp table name while doing incremental in dbt snowflake](https://discourse.getdbt.com/t/change-the-tmp-table-name-while-doing-incremental-in-dbt-snowflake/18718)

<div class="topic-metadata">

**Author:** [@ANGEL](https://discourse.getdbt.com/u/ANGEL)\
**Replies:** 1\
**Last updated:** [March 20, 2025, 1:32pm UTC](https://discourse.getdbt.com/t/change-the-tmp-table-name-while-doing-incremental-in-dbt-snowflake/18718 "2025-03-20T13:32:29Z")

</div>

The problem I’m having Database used - Snowflake Adapters I have created a model with incremental config and it uploads files from s3 to a table suppose LND\_TABLES. Now with internal working of dbt it tends to create a…

---

## [How to resolve "Subquery containing correlated aggregate function can only appear in having or select clause"](https://discourse.getdbt.com/t/how-to-resolve-subquery-containing-correlated-aggregate-function-can-only-appear-in-having-or-select-clause/5031)

<div class="topic-metadata">

**Author:** [@ron.chipman](https://discourse.getdbt.com/u/ron.chipman)\
**Replies:** 12\
**Last updated:** [February 21, 2025, 11:51pm UTC](https://discourse.getdbt.com/t/how-to-resolve-subquery-containing-correlated-aggregate-function-can-only-appear-in-having-or-select-clause/5031 "2025-02-21T23:51:37Z")

</div>

If you are just diving into doing incrementals using Snowflake as your DB of choice, here is a quick learning that I recently had (thank you @jerco for the assist). If you copy and paste the example code from the increm…

---

## [Resolving Snowflake MERGE Issues for Versioned AppsFlyer Data with dbt Incremental Models](https://discourse.getdbt.com/t/resolving-snowflake-merge-issues-for-versioned-appsflyer-data-with-dbt-incremental-models/17601)

<div class="topic-metadata">

**Author:** [@hediketari](https://discourse.getdbt.com/u/hediketari)\
**Replies:** 1\
**Last updated:** [January 6, 2025, 11:04am UTC](https://discourse.getdbt.com/t/resolving-snowflake-merge-issues-for-versioned-appsflyer-data-with-dbt-incremental-models/17601 "2025-01-06T11:04:25Z")

</div>

The problem I’m having I’m trying to load versioned data from AppsFlyer into Snowflake using an incremental dbt model that leverages a MERGE statement. However, dbt keeps generating a statement like: create or replace t…

---

## [New columns destroy my incremental table?](https://discourse.getdbt.com/t/new-columns-destroy-my-incremental-table/18205)

<div class="topic-metadata">

**Author:** [@domischmidt1337](https://discourse.getdbt.com/u/domischmidt1337)\
**Replies:** 0\
**Last updated:** [February 13, 2025, 9:15pm UTC](https://discourse.getdbt.com/t/new-columns-destroy-my-incremental-table/18205 "2025-02-13T21:15:37Z")

</div>

Hi, we are having issues with our log\_history tables in Snowflake. They are made up in dbt and build with an incremental refresh. So twice a month, we are getting a new dataset added below the previous data with a new t…

[Next page](https://discourse.getdbt.com/tag/incremental/18.md?match_all_tags=true&page=1&tags%5B%5D=incremental)