Greetings All! Trying to run a snowflake ingestio...
# ingestion
m
Greetings All! Trying to run a snowflake ingestion which succeed last time I executed but now I get error:
Copy code
'File "/tmp/datahub/ingest/venv-61422838-a72c-4c58-991f-380cbc29cafc/lib/python3.9/site-packages/datahub/ingestion/api/registry.py", line '
           '132, in get\n'
           '    115  def get(self, key: str) -> Type[T]:\n'
           ' (...)\n'
           '    128          raise ConfigurationError(\n'
           '    129              f"{key} is disabled; try running: pip install \'{__package_name__}[{key}]\'"\n'
           '    130          ) from tp\n'
           '    131      elif isinstance(tp, Exception):\n'
           '--> 132          raise ConfigurationError(\n'
           '    133              f"{key} is disabled due to an error in initialization"\n'
Thoughts??
s
In the full log is there an import error somewhere? If yes, might be related to https://datahubspace.slack.com/archives/CUMV92XRQ/p1648134009950579
m
Yeah I think so, but I am discovering that everything is now broken
s
I know that is why I added that in announcements. I made a fix which fixed almost everything. But superset connector got missed which we caught in internal testing before doing a new CLI release. Have raised another PR. Once all internal testing passes we will be doing a new CLI release.
👍 1
m
still seeing the same failures after update to 8.31.3, all previously successful ingestions are failing:
Copy code
'File "/tmp/datahub/ingest/venv-82c9de55-ae3f-4eaa-b2fd-1e63b7e6d02a/lib/python3.9/site-packages/datahub/ingestion/api/registry.py", line '
           '132, in get\n'
           '    115  def get(self, key: str) -> Type[T]:\n'
           ' (...)\n'
           '    128          raise ConfigurationError(\n'
           '    129              f"{key} is disabled; try running: pip install \'{__package_name__}[{key}]\'"\n'
           '    130          ) from tp\n'
           '    131      elif isinstance(tp, Exception):\n'
           '--> 132          raise ConfigurationError(\n'
           '    133              f"{key} is disabled due to an error in initialization"\n'
           '\n'
           'ConfigurationError: mysql is disabled due to an error in initialization\n',
           "2022-03-24 20:55:46.596236 [exec_id=82c9de55-ae3f-4eaa-b2fd-1e63b7e6d02a] INFO: Failed to execute 'datahub ingest'",
           '2022-03-24 20:55:46.602270 [exec_id=82c9de55-ae3f-4eaa-b2fd-1e63b7e6d02a] INFO: Caught exception EXECUTING '
           'task_id=82c9de55-ae3f-4eaa-b2fd-1e63b7e6d02a, name=RUN_INGEST, stacktrace=Traceback (most recent call last):\n'
           '  File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/default_executor.py", line 119, in execute_task\n'
           '    self.event_loop.run_until_complete(task_future)\n'
``````
…executed from the web-interface
Performed a clean install of datahub 0.8.31.3 seemed to clear up the issue.