# How can we access AWS S3 buckets from DBT

**URL:** <https://discourse.getdbt.com/t/how-can-we-access-aws-s3-buckets-from-dbt/12053>\
**Category:** Help\
**Tags:** dbt-cloud\
**Created:** [February 14, 2024, 6:23pm UTC](https://discourse.getdbt.com/t/how-can-we-access-aws-s3-buckets-from-dbt/12053 "2024-02-14T18:23:09Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![shylashree.dr](https://sea2.discourse-cdn.com/flex020/user_avatar/discourse.getdbt.com/shylashree.dr/32/3627_2.png) [@shylashree.dr](https://discourse.getdbt.com/u/shylashree.dr)\
**Post date:** [February 14, 2024, 6:23pm UTC](https://discourse.getdbt.com/t/how-can-we-access-aws-s3-buckets-from-dbt/12053/1 "2024-02-14T18:23:09Z")

</div>

Hello Everyone!!  
I’m working on a use case where I need to directly interact with S3 buckets to read files, such as CSVs, Parquet files, or other data formats stored in S3. Are there any best practices or recommended approaches for integrating S3 data into dbt models and transformations?

Any insights, experiences, or recommendations would be greatly appreciated! Thank you in advance for sharing your knowledge with the community.

---

<div class="post-metadata">

**Author:** ![a\_slack\_user](https://sea2.discourse-cdn.com/flex020/user_avatar/discourse.getdbt.com/a_slack_user/32/1629_2.png) [@a\_slack\_user](https://discourse.getdbt.com/u/a_slack_user)\
**Post date:** [February 14, 2024, 6:34pm UTC](https://discourse.getdbt.com/t/how-can-we-access-aws-s3-buckets-from-dbt/12053/2 "2024-02-14T18:34:02Z")

</div>

duckdb supports working directly with s3 and can work with dbt as well  
[https://duckdb.org/docs/guides/import/s3\_import](https://duckdb.org/docs/guides/import/s3_import)

Note: `@Gio` originally [posted this reply in Slack](https://getdbt.slack.com/archives/CBSQTAPLG/p1707935635171879?thread_ts=1707935015.796319&cid=CBSQTAPLG). It might not have transferred perfectly.

---

<div class="post-metadata">

**Author:** ![prajaktachitale](https://avatars.discourse-cdn.com/v4/letter/p/a587f6/32.png) [@prajaktachitale](https://discourse.getdbt.com/u/prajaktachitale)\
**Post date:** [February 29, 2024, 4:15pm UTC](https://discourse.getdbt.com/t/how-can-we-access-aws-s3-buckets-from-dbt/12053/3 "2024-02-29T16:15:03Z")

</div>

Can you please provide the example of using DuckDB with AWS and dbt?  
Also, is it supported by both core and cloud versions?

---

<div class="post-metadata">

**Author:** ![svdimchenko](https://sea2.discourse-cdn.com/flex020/user_avatar/discourse.getdbt.com/svdimchenko/32/1569_2.png) [@svdimchenko](https://discourse.getdbt.com/u/svdimchenko)\
**Post date:** [March 6, 2024, 6:09pm UTC](https://discourse.getdbt.com/t/how-can-we-access-aws-s3-buckets-from-dbt/12053/4 "2024-03-06T18:09:04Z")

</div>

You can use [GitHub - dbt-athena/dbt-athena: The athena adapter plugin for dbt (https://getdbt.com)](https://github.com/dbt-athena/dbt-athena) adapter for that, it supports both hive and iceberg tables currently.

Another option may be [GitHub - aws-samples/dbt-glue: This repository contains de dbt-glue adapter](https://github.com/aws-samples/dbt-glue), it may be costly but better performance for huge data volumes.

Actually it depends on your current infra and toolkit available as then some other options may be also possible.
