dbt-core dbt-snowflake upgrade issues v0.21 to v1.8

Help
, ,
1

We are upgrading from an old dbt version 0.21 to dbt 1.8.
Facing issue with migrating dbt view models which include column descriptions.

Current Environment:
Python 3.9.13
dbt-core 0.21
dbt-snowflake 0.21
jinja2 2.11.3

Upgrading to:
Python 3.9.13
dbt-core 1.8.0
bbt-snowflake 1.8.0
jinja2 3.1.5

In dbt v0.21, column descriptions for views do not propagate to snowflake (persist_docs config does not apply to views). To workaround this, the ‘alias’ property in model’s config block was used to supply the column description (creatively, I might add). This worked perfect for us in 0.21 (Refer below code samples)

In dbt v1.8, of course, column descriptions for views do propagate to snowflake (persist_docs config applies to views too). I see dbt adds the column names to the runtime sql created, unlike 0.21. In addition, the jinja2 package version used here also parses the escape characters in the jinja code differently. These changes have led to the dbt generated runtime sql to fail due to sql syntax issues. (Refer below code samples)

It is understood that one way to resolve is to move the view’s column descriptions to a yml file, or use a post-hook. This will resolve the issue. But in our project, there are 450+ such views, with some of them having hundreds of columns. So I am looking for a faster way to implement and validate. Appreciate any pointers.

Sample dbt model

{{
  config(
    materialized = 'view',
    alias = 'dateandtime comment = \'Information on current date and time\'
    (
      CDATE comment \'Current Date\'
      ,CTIME comment \'Current Time\'
      ,CDAY comment \'Current Day\'
    )'
    )
}}

select
    current_date() as cdate,
    current_time() as ctime,
    day(current_date) as cday

Runtime sql - v0.21 (Generated SQL executes successfully)


  create or replace  view dateandtime comment = 'Information on current date and time'
    (
      CDATE comment 'Current Date'
      ,CTIME comment 'Current Time'
      ,CDAY comment 'Current Day'
    )  as (
    

select
    current_date() as cdate,
    current_time() as ctime,
    day(current_date) as cday
  );

Runtime sql - v1.8 (Genrated SQL results in error)

create or replace   view dateandtime comment = \'Information on current date and time\'

    (

      CDATE comment \'Current Date\'

      ,CTIME comment \'Current Time\'

      ,CDAY comment \'Current Day\'

    )
  
    
    
(
  
    "CDATE" COMMENT $$$$, 
  
    "CTIME" COMMENT $$$$, 
  
    "CDAY" COMMENT $$$$
  
)

   as (
    

select
    current_date() as cdate,
    current_time() as ctime,
    day(current_date) as cday
  );