Hi guys,
I am trying to ingest snowflake metadata ...
# ingestiong
gorgeous-glass-57878
08/18/2021, 4:58 PMHi guys,
I am trying to ingest snowflake metadata into Datahub but getting this error - pkg_resources.ContextualVersionConflict: (certifi 2021.5.30 (/usr/local/lib/python3.8/site-packages), Requirement.parse('certifi<2021.0.0'), {'snowflake-connector-python'})
My snowflake recipe structure looks like this -
source:b
big-carpet-38439
08/18/2021, 5:22 PM@mammoth-bear-12532 @witty-state-99511 Any ideas?
w
witty-state-99511
08/18/2021, 5:23 PMseems like a snowflake connector dependency issue
b
big-carpet-38439
08/18/2021, 5:27 PMyes, it is
g
gorgeous-glass-57878
08/18/2021, 6:48 PMHow to solve this?
m
mammoth-bear-12532
08/18/2021, 6:54 PM
@gorgeous-glass-57878 do you have a pip venv just dedicated to datahub?
mammoth-bear-12532
08/19/2021, 2:37 PM
@gorgeous-glass-57878 does this happen even in a dedicated venv?
g
gorgeous-glass-57878
08/20/2021, 5:07 AMLet me check and get back to you. We used the same environment for different database ingestion, and it worked fine.
gorgeous-glass-57878
09/02/2021, 7:10 AMThe error is coming in the pod. The issue seems to be with the image we are using. Can anyone help to resolve this?
b
big-carpet-38439
09/02/2021, 4:39 PMwhich image and version are you using?
g
gorgeous-glass-57878
09/07/2021, 7:02 AMdatahub-ingestion-cron:
enabled: false
image:
repository: linkedin/datahub-ingestion
tag: "latest"
e
early-lamp-41924
09/07/2021, 6:18 PMCan you try using tag: “head” ?
early-lamp-41924
09/07/2021, 6:19 PMor the same version you are using for everything else like “v0.8.11”
2 Views