I am new to dbt and would like to know if dbt is an ETL tool? I am trying to create models where my source table is in postgres but I would like my target model table to be created in Redshift can I do that using dbt? Another use case both source and target tables are in redshift same warehouse bu…

Hey Pallavi! dbt doesn’t do any sort of data extraction or loading – there are many other tools that excel at this task like Singer/Stitch, Fivetran, AWS DMS, etc. For loading data from Postgres into Redshift, I think a tool like Singer or AWS DMS might be your best bet. So, rather than extraction …

Thanks for your reply so its basically you can just build models on the same warehouse and same database. what if I need to move my old model table to new database do I have to rebuild all again?

I think your options are to rebuild or if it’s an incremental model you could unload and copy. I don’t believe redshift supports creating a table from a different database but I’m not 100% sure about that.

Thankyou! I guess it doesn’t will have to use unload and copy into s3.

Thanks alot for detailed explanation. This makes so much sense!!

Is dbt an ETL tool?

Help

mplovepop August 24, 2018, 5:05pm 2

I don’t believe dbt can handle either of those use cases. It’s the “T” in ETL. For “EL,” AWS has DMS to replicate from Postgres to Redshift (doesn’t work if you have jsonb columns), or Stitch Data can do the same.

Topic		Replies	Views
Could DBT be used to migrate data between operational databases? Archive	6	15447	June 11, 2020
Population source tables on AWS stack Archive	0	1714	January 11, 2022
Reading data from S3 and loading it into Redshift for the transformation we have to use dbt core Help redshift , dbt-core	3	1785	January 4, 2024
Migration between databases? Archive	1	3974	December 23, 2020
Building dbt models to be compatible with multiple data warehouses In-Depth Discussions	2	10268	October 15, 2022

Is dbt an ETL tool?

Related topics