Hi all,
I am running into an issue with the naming of iceberg tables stored as parquet within S3 on AWS.
Given the following example config block:
{{
config(
s3_data_dir='example',
s3_data_naming='demand',
format='parquet',
write_compression='GZIP',
materialized='incremental',
table_type='iceberg',
incremental_strategy = 'merge',
unique_key = ['foo', 'bar', 'foobar'],
tags=["dbt"]
)
}}
The S3 prefix within the bucket ends up with some sort of UUID on the end, such as:
s3://example-bucket/foobar/demand__dbt_tmp-b4b0bc8fde2247bd9e22eda7ed8afd5c/
This was done with:
Running with dbt=1.6.2
Registered adapter: trino=1.6.1
Any ideas as to why it contains the ID and how to disable it?