Hi I have installed datahub over a dbt edp image ...
# all-things-deployment
c
Hi I have installed datahub over a dbt edp image By using pip install acryl-datahub==0.8.38 But I am still getting error No module named - datahub provider
@dazzling-judge-80093 @square-activity-64562 @bulky-soccer-26729 @big-carpet-38439 Anyone ?
b
Hi Karishma! so the error you're getting is
No module named - datahub provider
? and that's when you run the pip install above. if you run
datahub version
what do you get?
c
I am getting Acryl-datahub version 0.8.38
And I also run the command datahub check plugins And I am getting the response But when I am using the same image in airflow Dag which has dbt stage It's giving me error there
b
hmmm
c
You needs the whole logs ?
b
that would be helpful!
c
Please check once
b
okay gotcha so yeah not everything is installed properly like it's expecting to. and you've gone through all the steps mentioned in this doc? https://datahubproject.io/docs/lineage/airflow/#setting-up-airflow-to-use-datahub-as-lineage-backend
c
Yup I have done all the steps and it is installed by other dummy dags are running
But one dag having dbt task is failing with this error
d
Have you installed
acryl-datahub[airflow]
as well?
c
Yup on airflow image I did
b
okay so it's only the dbt dag but others are working properly?
c
Both acryl-datahub And acryl-datahub airflow Needs to get installed over dbt and airflow image both ?
In airflow we have a dag which has dbt tasks And it's getting failed there
Any update @bulky-soccer-26729
b
sorry for the delay! I personally have less experience with airflow so I'm trying to find someone that will be able to help you better than myself
d
Can you share the full stacktrace?
I wonder why it is looking for datahub_provider if you only want to ingest data to datahub but don’t need lineage information from airflow dag
c
It is resolved now thank you
d
Awesome
s
@creamy-van-28626 what was the problem? Will help others in the community too
c
We have done changes in dbt image by installing the datahub module there but that changes was not picked properly as it was still pointing to old image So we point to new one and it worked