The problem I’m having is my dbt project running on Databricks cluster, the job is suddenly failing with
run failed with error message
Your administrator has only allowed sql and python commands on this cluster. This execution contained at least one disallowed language.
Cluster details :
Databricks Runtime Version - 14.3 LTS (includes Apache Spark 3.5.0, Scala 2.12)
Worker type : Standard_D4ads_v5
I’ve already tried checking my code for language other than SQL and python. I don’t have any other language, but still the job gives error at the end even though all the dbt succeed.
Some example code or error messages
Your administrator has only allowed sql and python commands on this cluster. This execution contained at least one disallowed language.
ANTLR Tool version 4.8 used for code generation does not match the current runtime version 4.9.3
ANTLR Tool version 4.8 used for code generation does not match the current runtime version 4.9.3
ANTLR Tool version 4.8 used for code generation does not match the current runtime version 4.9.3
Tue Mar 26 05:06:37 2024 Connection to spark from PID 1597
Tue Mar 26 05:06:37 2024 Initialized gateway on port 36189
Tue Mar 26 05:06:38 2024 Connected to spark.
All the models are successful but the cluster gives error :
07:49:21 Finished running 27 view models, 11 table models, 1 incremental model in 0 hours 6 minutes and 24.82 seconds (384.82s).
07:49:21 Completed successfully
07:49:21 Done. PASS=39 WARN=0 ERROR=0 SKIP=0 TOTAL=39
How do I resolve this error?