Hi team!
I am trying out the dbt-athena
adapter on dbt Cloud. I’m facing some challenges though in the incremental model
part of it.
I have Hive tables in Athena and my model config looks like this:
{{ config(
materialized='incremental',
partitioned_by=["aggregation_date"],
external_location='~/fact__player_transfers/'
) }}
I’ve shortened the external location, which is otherwise legit.
When I execute the model in a full-refresh mode it is all well (partitions get created), but when I do an incremental run the error that I always get is
21:56:22 Unhandled error while executing
An error occurred (NoSuchBucket) when calling the ListObjectsV2 operation: The specified bucket does not exist
The AWS role assigned to this user has all rights to S3, Athena and Glue.
Hope you might shed some light on to what I might be missing.