hey guys, trying to run elementary 0.12.0 on Kuber...
# community-support
s
hey guys, trying to run elementary 0.12.0 on Kubernetes and the
edr report
is failing in dbt run operations. These are the only logs I'm getting so is there any way to enable more verbose logs or something? It is definitely looking at the correct Databricks catalog and schema, the elementary tables exist and are populated, no queries from these errors are actually making it to Databricks (no queries in history) and this all works when I run it locally. Does anyone have any suggestions?
r
Even i have been getting same error for 2 months and no resolution yet
@Daniel Pollak
n
Hey @Sean Carmichael Do you happen to have the
edr.log
after this run? It might hold more information Also can you share the entire command you’re running? Did you follow all the guidlines from the tutorial? was it ever working or is it the first time you’re running it? Sorry for all the inquiries just want to cover all options
s
Hey @Noa Dagan • I was able to grab the edr.log file from the kube pod but it looks pretty unhelpful but ill provide it. (edr.log) • Since updating it to 0.13.2 we have a new error, it hasnt really helped me solve the issue but ill provide that too. (send_edr_to_s3.log) • I have followed the tutorial, our dbt project has the right models set up and packages installed. The job runs dbt deps and dbt test before running edr send-report. The specific command im running is
edr send-report --s3-bucket-name plentiau-dataplatform-elementary --bucket-file-path elementary_report.html --project-dir /dbt/lake/ --profiles-dir /dbtprofiles --env prod
• The runs completely fine on my local machine, just when running it from a dockerfile in Kubernetes it never works, even after clearing the elementary schema in databricks and remaking them. Thanks a tonne for taking the time to help 🙂
r
No updates yet on above issue
o
Hey @Sean Carmichael blob wave from the logs it looks like the
dbt
command is unavailable from where you run
edr
. this is an issue, as
edr
runs the
dbt
command in order to query the data for the report
s
hey @Ofek Weiss, I dont think that is the case as in the same job, in the same location I run dbt test and dbt deps to set up the data for elementary
o
Interesting, can you share more info regarding how your job is orchestrated? the more details the better