Hello team! I have encountered a weird error after...
# troubleshoot
i
Hello team! I have encountered a weird error after I tried to ingest snowflake metadata (the recipe worked just fine until yesterday, but today it is raising errors). Here's the error and abridged log:
Copy code
[2023-05-24 16:52:58,950] INFO     {datahub.cli.ingest_cli:173} - DataHub CLI version: 0.10.2.2
[2023-05-24 16:52:59,141] INFO     {datahub.ingestion.run.pipeline:204} - Sink configured successfully. DataHubRestEmitter: configured to talk to <http://localhost:8080> with token: eyJh**********O9bU
[2023-05-24 16:53:03,611] ERROR    {datahub.entrypoints:195} - Command failed: Failed to find a registered source for type snowflake: Updating forward references for asset model PandasCSVAsset raised TypeError: issubclass() arg 1 must be a class
And here's the recipe:
Copy code
source:
  type: "snowflake"
  config:
    username: "${SNOWFLAKE_USERID}"
    password: "${SNOWFLAKE_PASSWORD}"
    account_id: "real_account_name"
    warehouse: "bi_transforming_development"
    database_pattern:
      allow:
        - "^ANALYTICS_DBT_PROD$"
    schema_pattern:
      allow:
        - "^PROD$"
    role: "analyst"
sink:
  type: "datahub-rest"
  config:
    token: "${TOKEN}"
Using the UI with the same credentials is working, and the environment variables appear to be ingested correctly at least in the case of the token (also, hard-coding the variables in the recipe does not solve the problem either). Thank you for any help!
1
This fixed itself after reinstalling everything in a new venv, and docker system pruning (for a second time, as the first time doing this didn't work)...