Hi Team, I am trying to ingest airflow metadata in...
# troubleshoot
l
Hi Team, I am trying to ingest airflow metadata into datahub and need help resolving following error(attached screen shot). We are on datahub 0.8.45, installed acryl-datahub-airflow-plug==0.9.2.2. Attached screen shots of Task, datahub airflow operator import, datahub connector, airflow config additions. Added [core] lazy_load_plugins = False @dazzling-judge-80093, @gray-shoe-75895
g
The log message just says that airflow failed to fetch logs from the worker
Please work that out and post the actual error from the task here
l
@gray-shoe-75895, Thanks will do
Hi @gray-shoe-75895, I am facing below connection error when my task tried to emit metadata. Attached screen shot of Task and error message. Appreciate any help.
d
Can you try to check if you can access datahub from the pod/node where you run your task?
l
@dazzling-judge-80093 running into SSL error, working internally to import the certs to Airflow dockerfile. Appreciate if you can share any insights.
@dazzling-judge-80093/ @gray-shoe-75895 got past ssl, I am getting 401. We have GMS token as password, and https://ingress/url as host. Attached is the screen shot. Any insight on what's missing
message has been deleted
d
hmm, if the token is exactly set as password then it should be fine
Please, can you doublecheck if the token is correct?
l
Will try curl, token is good, while creating airflow connection should I use username?
d
No, username doesn’t need
l
@dazzling-judge-80093 created a new PAT after creating a policy with extended permissions( all privileges) to the user. When ran CURL with HTTP returned nothing, more like success. When ran CURL with HTTPS got below SSL error.
@dazzling-judge-80093 , locally ran curl with the new PAT I created after assigning elevated privileges to the user. I am seeing 404. Service: /api/gms/entities?action=ingest