Hi dbt folks,
I’m just getting started in the IDE and having trouble building my first model. I have created a connection with databricks. my code is very simple : here is my model: select ‘1’ as id
Here is my dbt_project.yml:
model-paths: [“models”]
analysis-paths: [“analyses”]
test-paths: [“tests”]
seed-paths: [“seeds”]
macro-paths: [“macros”]
snapshot-paths: [“snapshots”]
target-path: “target” # directory which will store compiled SQL files
dbt-cloud:
project-id: 339223
My build keeps failing but I am not getting a clear error message. Here is the full log:
{“data”: {“kwargs”: “{‘category’: ‘dbt’, ‘action’: ‘invocation’, ‘label’: ‘start’, ‘context’: [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x7fd51008b0d0>, <snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x7fd51087bee0>, <snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x7fd502ac3820>]}”}, “info”: {“category”: “”, “code”: “Z040”, “extra”: {}, “invocation_id”: “01fc26c3-543b-4746-b321-710847e9286b”, “level”: “debug”, “msg”: “Sending event: {‘category’: ‘dbt’, ‘action’: ‘invocation’, ‘label’: ‘start’, ‘context’: [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x7fd51008b0d0>, <snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x7fd51087bee0>, <snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x7fd502ac3820>]}”, “name”: “SendingEvent”, “pid”: 70, “thread”: “MainThread”, “ts”: “2024-01-23T21:34:57.009243Z”}}
{“data”: {“log_version”: 3, “version”: “=1.7.5”}, “info”: {“category”: “”, “code”: “A001”, “extra”: {}, “invocation_id”: “01fc26c3-543b-4746-b321-710847e9286b”, “level”: “info”, “msg”: “Running with dbt=1.7.5”, “name”: “MainReportVersion”, “pid”: 70, “thread”: “MainThread”, “ts”: “2024-01-23T21:34:57.009771Z”}}
{“data”: {“args”: {“cache_selected_only”: “False”, “debug”: “False”, “fail_fast”: “False”, “indirect_selection”: “eager”, “introspect”: “True”, “invocation_command”: “dbt -A dbt_worker.app worker --loglevel=DEBUG --concurrency=2 --max-memory-per-child=500000”, “log_cache_events”: “False”, “log_format”: “json”, “log_path”: “/usr/src/dbt-server-shared/working_dir/1b6ba3b4-b217-44c2-a751-df0e974caaf9”, “no_print”: “None”, “partial_parse”: “True”, “printer_width”: “80”, “profiles_dir”: “/usr/src/dbt-server-shared/.dbt”, “quiet”: “False”, “send_anonymous_usage_stats”: “True”, “static_parser”: “True”, “target_path”: “None”, “use_colors”: “True”, “use_experimental_parser”: “False”, “version_check”: “True”, “warn_error”: “None”, “warn_error_options”: “WarnErrorOptions(include=, exclude=)”, “write_json”: “True”}}, “info”: {“category”: “”, “code”: “A002”, “extra”: {}, “invocation_id”: “01fc26c3-543b-4746-b321-710847e9286b”, “level”: “debug”, “msg”: “running dbt with arguments {‘printer_width’: ‘80’, ‘indirect_selection’: ‘eager’, ‘write_json’: ‘True’, ‘log_cache_events’: ‘False’, ‘partial_parse’: ‘True’, ‘cache_selected_only’: ‘False’, ‘warn_error’: ‘None’, ‘debug’: ‘False’, ‘profiles_dir’: ‘/usr/src/dbt-server-shared/.dbt’, ‘log_path’: ‘/usr/src/dbt-server-shared/working_dir/1b6ba3b4-b217-44c2-a751-df0e974caaf9’, ‘fail_fast’: ‘False’, ‘version_check’: ‘True’, ‘use_colors’: ‘True’, ‘use_experimental_parser’: ‘False’, ‘no_print’: ‘None’, ‘quiet’: ‘False’, ‘log_format’: ‘json’, ‘introspect’: ‘True’, ‘static_parser’: ‘True’, ‘invocation_command’: ‘dbt -A dbt_worker.app worker --loglevel=DEBUG --concurrency=2 --max-memory-per-child=500000’, ‘target_path’: ‘None’, ‘warn_error_options’: ‘WarnErrorOptions(include=, exclude=)’, ‘send_anonymous_usage_stats’: ‘True’}”, “name”: “MainReportArgs”, “pid”: 70, “thread”: “MainThread”, “ts”: “2024-01-23T21:34:57.010227Z”}}
{“data”: {“kwargs”: “{‘category’: ‘dbt’, ‘action’: ‘project_id’, ‘label’: ‘01fc26c3-543b-4746-b321-710847e9286b’, ‘context’: [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x7fd4ab738d90>]}”}, “info”: {“category”: “”, “code”: “Z040”, “extra”: {}, “invocation_id”: “01fc26c3-543b-4746-b321-710847e9286b”, “level”: “debug”, “msg”: “Sending event: {‘category’: ‘dbt’, ‘action’: ‘project_id’, ‘label’: ‘01fc26c3-543b-4746-b321-710847e9286b’, ‘context’: [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x7fd4ab738d90>]}”, “name”: “SendingEvent”, “pid”: 70, “thread”: “MainThread”, “ts”: “2024-01-23T21:34:57.030925Z”}}
{“data”: {“kwargs”: “{‘category’: ‘dbt’, ‘action’: ‘adapter_info’, ‘label’: ‘01fc26c3-543b-4746-b321-710847e9286b’, ‘context’: [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x7fd508913e50>]}”}, “info”: {“category”: “”, “code”: “Z040”, “extra”: {}, “invocation_id”: “01fc26c3-543b-4746-b321-710847e9286b”, “level”: “debug”, “msg”: “Sending event: {‘category’: ‘dbt’, ‘action’: ‘adapter_info’, ‘label’: ‘01fc26c3-543b-4746-b321-710847e9286b’, ‘context’: [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x7fd508913e50>]}”, “name”: “SendingEvent”, “pid”: 70, “thread”: “MainThread”, “ts”: “2024-01-23T21:34:57.032416Z”}}
{“data”: {“adapter_name”: “databricks”, “adapter_version”: “=1.7.3”}, “info”: {“category”: “”, “code”: “E034”, “extra”: {}, “invocation_id”: “01fc26c3-543b-4746-b321-710847e9286b”, “level”: “info”, “msg”: “Registered adapter: databricks=1.7.3”, “name”: “AdapterRegistered”, “pid”: 70, “thread”: “MainThread”, “ts”: “2024-01-23T21:34:57.032901Z”}}
{“data”: {“kwargs”: “{‘category’: ‘dbt’, ‘action’: ‘resource_counts’, ‘label’: ‘01fc26c3-543b-4746-b321-710847e9286b’, ‘context’: [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x7fd4a9f90f40>]}”}, “info”: {“category”: “”, “code”: “Z040”, “extra”: {}, “invocation_id”: “01fc26c3-543b-4746-b321-710847e9286b”, “level”: “debug”, “msg”: “Sending event: {‘category’: ‘dbt’, ‘action’: ‘resource_counts’, ‘label’: ‘01fc26c3-543b-4746-b321-710847e9286b’, ‘context’: [<snowplow_tracker.self_describing_json.SelfDescribingJson object at 0x7fd4a9f90f40>]}”, “name”: “SendingEvent”, “pid”: 70, “thread”: “MainThread”, “ts”: “2024-01-23T21:34:57.068235Z”}}
{“data”: {“stat_line”: “1 model, 0 sources, 0 exposures, 0 metrics, 534 macros, 0 groups, 0 semantic models”}, “info”: {“category”: “”, “code”: “W006”, “extra”: {}, “invocation_id”: “01fc26c3-543b-4746-b321-710847e9286b”, “level”: “info”, “msg”: “Found 1 model, 0 sources, 0 exposures, 0 metrics, 534 macros, 0 groups, 0 semantic models”, “name”: “FoundStats”, “pid”: 70, “thread”: “MainThread”, “ts”: “2024-01-23T21:34:57.068782Z”}}
{“data”: {“msg”: “”}, “info”: {“category”: “”, “code”: “Z017”, “extra”: {}, “invocation_id”: “01fc26c3-543b-4746-b321-710847e9286b”, “level”: “info”, “msg”: “”, “name”: “Formatting”, “pid”: 70, “thread”: “MainThread”, “ts”: “2024-01-23T21:34:57.069889Z”}}
{“data”: {“args”: , “base_msg”: "Creating DatabricksDBTConnection. name: master, thread: (70, 140553145915200), compute: ", "name": "Databricks"}, "info": {"category": "", "code": "E001", "extra": {}, "invocation_id": "01fc26c3-543b-4746-b321-710847e9286b", "level": "debug", "msg": "Databricks adapter: Creating DatabricksDBTConnection. name: master, thread: (70, 140553145915200), compute: ", “name”: “AdapterEventDebug”, “pid”: 70, “thread”: “MainThread”, “ts”: “2024-01-23T21:34:57.070392Z”}}
{“data”: {“conn_name”: “master”, “conn_type”: “databricks”}, “info”: {“category”: “”, “code”: “E005”, “extra”: {}, “invocation_id”: “01fc26c3-543b-4746-b321-710847e9286b”, “level”: “debug”, “msg”: “Acquiring new databricks connection ‘master’”, “name”: “NewConnection”, “pid”: 70, “thread”: “MainThread”, “ts”: “2024-01-23T21:34:57.070820Z”}}
{“data”: {“args”: , “base_msg”: “DatabricksDBTConnection._acquire: name: master, thread: (70, 140553145915200), compute: , acquire_release_count: 0, idle time: 0s", "name": "Databricks"}, "info": {"category": "", "code": "E001", "extra": {}, "invocation_id": "01fc26c3-543b-4746-b321-710847e9286b", "level": "debug", "msg": "Databricks adapter: DatabricksDBTConnection._acquire: name: master, thread: (70, 140553145915200), compute: , acquire_release_count: 0, idle time: 0s”, “name”: “AdapterEventDebug”, “pid”: 70, “thread”: “MainThread”, “ts”: “2024-01-23T21:34:57.071160Z”}}
{“data”: {“args”: , “base_msg”: “Thread (70, 140553145915200) using default compute resource.”, “name”: “Databricks”}, “info”: {“category”: “”, “code”: “E001”, “extra”: {}, “invocation_id”: “01fc26c3-543b-4746-b321-710847e9286b”, “level”: “debug”, “msg”: “Databricks adapter: Thread (70, 140553145915200) using default compute resource.”, “name”: “AdapterEventDebug”, “pid”: 70, “thread”: “MainThread”, “ts”: “2024-01-23T21:34:57.071487Z”}}
{“data”: {“args”: , “base_msg”: "Creating DatabricksDBTConnection. name: list_zoe, thread: (70, 140551339722496), compute: ", "name": "Databricks"}, "info": {"category": "", "code": "E001", "extra": {}, "invocation_id": "01fc26c3-543b-4746-b321-710847e9286b", "level": "debug", "msg": "Databricks adapter: Creating DatabricksDBTConnection. name: list_zoe, thread: (70, 140551339722496), compute: “, “name”: “AdapterEventDebug”, “pid”: 70, “thread”: “ThreadPoolExecutor-0_0”, “ts”: “2024-01-23T21:34:57.072396Z”}}
{“data”: {“conn_name”: “list_zoe”, “conn_type”: “databricks”}, “info”: {“category”: “”, “code”: “E005”, “extra”: {}, “invocation_id”: “01fc26c3-543b-4746-b321-710847e9286b”, “level”: “debug”, “msg”: “Acquiring new databricks connection ‘list_zoe’”, “name”: “NewConnection”, “pid”: 70, “thread”: “ThreadPoolExecutor-0_0”, “ts”: “2024-01-23T21:34:57.072901Z”}}
{“data”: {“args”: , “base_msg”: “DatabricksDBTConnection._acquire: name: list_zoe, thread: (70, 140551339722496), compute: , acquire_release_count: 0, idle time: 0s", "name": "Databricks"}, "info": {"category": "", "code": "E001", "extra": {}, "invocation_id": "01fc26c3-543b-4746-b321-710847e9286b", "level": "debug", "msg": "Databricks adapter: DatabricksDBTConnection._acquire: name: list_zoe, thread: (70, 140551339722496), compute: , acquire_release_count: 0, idle time: 0s”, “name”: “AdapterEventDebug”, “pid”: 70, “thread”: “ThreadPoolExecutor-0_0”, “ts”: “2024-01-23T21:34:57.073271Z”}}
{“data”: {“args”: , “base_msg”: “Thread (70, 140551339722496) using default compute resource.”, “name”: “Databricks”}, “info”: {“category”: “”, “code”: “E001”, “extra”: {}, “invocation_id”: “01fc26c3-543b-4746-b321-710847e9286b”, “level”: “debug”, “msg”: “Databricks adapter: Thread (70, 140551339722496) using default compute resource.”, “name”: “AdapterEventDebug”, “pid”: 70, “thread”: “ThreadPoolExecutor-0_0”, “ts”: “2024-01-23T21:34:57.073610Z”}}
{“data”: {“conn_name”: “list_zoe”, “conn_type”: “databricks”}, “info”: {“category”: “”, “code”: “E015”, “extra”: {}, “invocation_id”: “01fc26c3-543b-4746-b321-710847e9286b”, “level”: “debug”, “msg”: “Using databricks connection "list_zoe"”, “name”: “ConnectionUsed”, “pid”: 70, “thread”: “ThreadPoolExecutor-0_0”, “ts”: “2024-01-23T21:34:57.073963Z”}}
{“data”: {“conn_name”: “list_zoe”, “sql”: “GetSchemas(database=zoe, schema=None)”}, “info”: {“category”: “”, “code”: “E016”, “extra”: {}, “invocation_id”: “01fc26c3-543b-4746-b321-710847e9286b”, “level”: “debug”, “msg”: “On list_zoe: GetSchemas(database=zoe, schema=None)”, “name”: “SQLQuery”, “pid”: 70, “thread”: “ThreadPoolExecutor-0_0”, “ts”: “2024-01-23T21:34:57.074255Z”}}
{“data”: {“connection_state”: “init”}, “info”: {“category”: “”, “code”: “E037”, “extra”: {}, “invocation_id”: “01fc26c3-543b-4746-b321-710847e9286b”, “level”: “debug”, “msg”: “Opening a new connection, currently in state init”, “name”: “NewConnectionOpening”, “pid”: 70, “thread”: “ThreadPoolExecutor-0_0”, “ts”: “2024-01-23T21:34:57.074549Z”}}”
What should I do?
Thank you!