Hi everyone, I am using Databricks on AWS with db...
# community-support
m
Hi everyone, I am using Databricks on AWS with dbt-core run via Databricks Workflows. The dbt-databricks library is installed onto the job cluster and is able to run the dbt models successfully. However, I’m encountering an issue while generating a report to be housed in a Databricks storage volume using Elementary. The process fails with the error
Failed to run dbt command
. Below are the details: ### Context: - ***Elementary version***: elementary-data 0.16.1 - ***dbt version***: 1.9.1 - ***Environment***: AWS - ***Database***: Databricks - ***Operation***:
edr report
### Context: 1. The error occurs when running the command:
Copy code
edr report --profiles-dir /Workspace/Users/<redacted>/.bundle/databricks_bundle/lab_nonprod/files/patterns/dbt/ --target-path /Volumes/<catalog>/elementary/reports/
2. This is isolated to when specifying a target with Databricks UC Volume ### Error Details: I have attached the error stack trace for context. ### Steps Taken So Far: 1. Verified
dbt
connectivity by running commands manually (e.g.,
dbt debug
,
dbt run
). 2. Checked the
profiles.yml
file to ensure all credentials and configurations are correct. 3. Ensured the environment has access to external services like
<http://app.posthog.com|app.posthog.com>
. ### Request: I would greatly appreciate it if someone could: - Help identify the root cause of this issue. - Suggest any additional debugging steps to resolve the problem. Thank you in advance for your support! Let me know if more details are needed. Best regards, Mukesh
👍 1