Hello Everyone. I've experienced an issue with Sno...
# troubleshoot
c
Hello Everyone. I've experienced an issue with Snowflake ingestion failing when it used to work. Here are my environment details: *****Environment********** Kubernetes deployment on AWS DataHub CLI version: 0.9.5 Python version: 3.7.10 (default, Jun 3 2021, 000201) [GCC 7.3.1 20180712 (Red Hat 7.3.1-13)] *****Ingestion Method********** I am trying both CLI and UI ingestions of my snowflake environment. *****Error********** datahub.ingestion.run.pipeline.PipelineInitError: Failed to find a registered source for type snowflake: snowflake is disabled; *****Debugging Step********** datahub check plugins --verbose snowflake (disabled) ModuleNotFoundError("No module named 'great_expectations.datasource.sqlalchemy_datasource'") *****Debugging Step********** pip3 list | grep SQLAlchemy Flask-SQLAlchemy 2.5.1 SQLAlchemy 1.4.40 SQLAlchemy-JSONField 1.0.0 SQLAlchemy-Utils 0.38.3 *****Debugging Step********** pip3 install 'acryl-datahub[sqlalchemy]' ---Requirement already satisfied: acryl-datahub[sqlalchemy] in /home/joshua.garza/.local/lib/python3.7/site-packages (0.9.5) *****Debugging Step********** pip3 install --upgrade great_expectations ---Requirement already satisfied: great_expectations in /home/joshua.garza/.local/lib/python3.7/site-packages (0.16.6) *****Debugging Step********** datahub check plugins --verbose ---snowflake (disabled) ModuleNotFoundError("No module named 'great_expectations.datasource.sqlalchemy_datasource'") Not sure what else to do here. Thanks in advance!
๐Ÿ” 1
๐Ÿ“– 1
โœ… 1
l
Hey there ๐Ÿ‘‹ I'm The DataHub Community Support bot. I'm here to help make sure the community can best support you with your request. Let's double check a few things first: โœ… There's a lot of good information on our docs site: www.datahubproject.io/docs, Have you searched there for a solution? โœ… It's not uncommon that someone has run into your exact problem before in the community. Have you searched Slack for similar issues? Did you find a solution to your issue? โŒ Sorry you weren't able to find a solution. I'm sending you some tips on info you can provide to help the community troubleshoot. Whenever you feel your issue is solved, please react โœ… to your original message to let us know!
c
a
Hi @cuddly-butcher-39945, @gentle-hamburger-31302 may be able to help you out here!
c
Thanks @astonishing-answer-96712 and @gentle-hamburger-31302
By the way, I was able to get the exact source to run on an instance of datahub v 10.1
Hey @astonishing-answer-96712 & @gentle-hamburger-31302 Any updates on this? I really appreciate the help.
a
Hi @cuddly-butcher-39945, sorry for the delay
Iโ€™ll check with @gentle-hamburger-31302 and see whatโ€™s up- he should be around to help you next week, and youโ€™re always welcome at office hours!
c
Hey @astonishing-answer-96712 I was so busy getting my 10.1 version up that I forgot about office hours. Any idea if we can look back into this? Thanks!
a
@hundreds-photographer-13496, could you help out here?
h
Hey @cuddly-butcher-39945 since when did this stop working ?
c
Hi @hundreds-photographer-13496 , it started failing last month
So, I just checked again, ran a datahub check plugins and Snowflake is enabled. Sources: athena (disabled) azure-ad bigquery (disabled) clickhouse (disabled) clickhouse-usage (disabled) csv-enricher datahub-business-glossary datahub-lineage-file dbt dbt-cloud delta-lake (disabled) demo-data druid (disabled) elasticsearch (disabled) feast (disabled) file glue hana hive (disabled) iceberg (disabled) json-schema kafka kafka-connect (disabled) ldap (disabled) looker lookml mariadb (disabled) metabase mode mongodb (disabled) mssql (disabled) mysql (disabled) nifi okta (disabled) openapi oracle (disabled) postgres powerbi (disabled) powerbi-report-server (disabled) presto (disabled) presto-on-hive (disabled) pulsar redash (disabled) redshift (disabled) redshift-usage (disabled) s3 (disabled) sagemaker salesforce (disabled) snowflake sqlalchemy starburst-trino-usage (disabled) superset tableau But still erroring out on a connection I know is valid.
Copy code
~~~~ Execution Summary ~~~~

RUN_INGEST - {'errors': [],
 'exec_id': '595d4629-c6af-425b-9cad-42a026bcab3f',
 'infos': ['2023-04-19 17:33:51.668238 [exec_id=595d4629-c6af-425b-9cad-42a026bcab3f] INFO: Starting execution for task with name=RUN_INGEST',
           '2023-04-19 17:34:08.598566 [exec_id=595d4629-c6af-425b-9cad-42a026bcab3f] INFO: stdout=venv setup time = 0\n'
           'This version of datahub supports report-to functionality\n'
           'datahub  ingest run -c /tmp/datahub/ingest/595d4629-c6af-425b-9cad-42a026bcab3f/recipe.yml --report-to '
           '/tmp/datahub/ingest/595d4629-c6af-425b-9cad-42a026bcab3f/ingestion_report.json\n'
           '[2023-04-19 17:33:57,905] INFO     {datahub.cli.ingest_cli:165} - DataHub CLI version: 0.9.5\n'
           '[2023-04-19 17:33:57,935] INFO     {datahub.ingestion.run.pipeline:179} - Sink configured successfully. DataHubRestEmitter: configured '
           'to talk to http://datahub-datahub-gms:8080\n'
           '[2023-04-19 17:34:03,100] ERROR    {datahub.entrypoints:213} - Command failed: Failed to find a registered source for type snowflake: '
           "snowflake is disabled; try running: pip install 'acryl-datahub[snowflake]'\n"
           'Traceback (most recent call last):\n'
Here are the results of testing the connection to Snowflake...
h
Where did you run
datahub check plugins
? The UI ingestion runs in a separate virtual environment inside datahub actions container. You can see the venv path something like this
/tmp/datahub/ingest/venv-snowflake-0.9.5
in ingestion logs.
a
Hi @cuddly-butcher-39945 I looked into this and it issue you are facing due to latest great-expectations version(the problem seems to have started from GE version >=0.16.4) automatically being used in DataHub 0.9.5 , whereas the version is restricted in latest DataHub version. Would you be able to use latest Datahub version for snowflake ingestion ?
c
I ran the datahub check plugins from the DataHub CLI (which is pointing to the GMS I am working with). So, is the only option to upgrade the 9.5 DataHub instance? Is there an easy way to upgrade it? Thanks
a
Oh, datahub check plugins command check plugins on local setup. One option without upgrade is to go to datahub actions container, activate virtual environment (/tmp/datahub/ingest/venv-snowflake-0.9.5) and manually install the great-expectations version 0.16.3 within it. However this is not permanent. If the container gets re-created, you'll have to install it again. Another easy option, since you are using managed ingestion is to specify latest cli version or any version after 0.9.6 in ingestion source. https://datahubproject.io/docs/ui-ingestion/#advanced-running-with-a-specific-cli-version
c
Awesome! It works!