Hi, getting this error while ingesting DataBricks ...
# troubleshoot
b
Hi, getting this error while ingesting DataBricks Tried reverting the library urllib3 to 1.26.0 as well as 1.24.3. Here are the logs
Copy code
~~~~ Execution Summary - RUN_INGEST ~~~~
Execution finished with errors.
{'exec_id': '7995ad9a-df8f-4ed3-85c1-f0032daa69de',
 'infos': ['2023-05-12 07:29:32.498479 INFO: Starting execution for task with name=RUN_INGEST',
           "2023-05-12 07:29:40.217073 INFO: Failed to execute 'datahub ingest'",
           '2023-05-12 07:29:40.217932 INFO: Caught exception EXECUTING task_id=7995ad9a-df8f-4ed3-85c1-f0032daa69de, name=RUN_INGEST, '
           'stacktrace=Traceback (most recent call last):\n'
           '  File "/usr/local/lib/python3.10/site-packages/acryl/executor/execution/default_executor.py", line 122, in execute_task\n'
           '    task_event_loop.run_until_complete(task_future)\n'
           '  File "/usr/local/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete\n'
           '    return future.result()\n'
           '  File "/usr/local/lib/python3.10/site-packages/acryl/executor/execution/sub_process_ingestion_task.py", line 231, in execute\n'
           '    raise TaskError("Failed to execute \'datahub ingest\'")\n'
           "acryl.executor.execution.task.TaskError: Failed to execute 'datahub ingest'\n"],
 'errors': []}

~~~~ Ingestion Logs ~~~~
Obtaining venv creation lock...
Acquired venv creation lock
venv setup time = 0
This version of datahub supports report-to functionality
datahub  ingest run -c /tmp/datahub/ingest/7995ad9a-df8f-4ed3-85c1-f0032daa69de/recipe.yml --report-to /tmp/datahub/ingest/7995ad9a-df8f-4ed3-85c1-f0032daa69de/ingestion_report.json
[2023-05-12 07:29:35,127] INFO     {datahub.cli.ingest_cli:173} - DataHub CLI version: 0.10.2
[2023-05-12 07:29:35,658] INFO     {datahub.ingestion.run.pipeline:204} - Sink configured successfully. DataHubRestEmitter: configured to talk to <http://datahub-gms:8080>
[2023-05-12 07:29:36,675] ERROR    {datahub.entrypoints:195} - Command failed: Failed to configure the source (unity-catalog): type object 'Retry' has no attribute 'DEFAULT_METHOD_WHITELIST'
Traceback (most recent call last):
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/datahub/ingestion/run/pipeline.py", line 119, in _add_init_error_context
    yield
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/datahub/ingestion/run/pipeline.py", line 217, in __init__
    self.source = source_class.create(
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/datahub/ingestion/source/unity/source.py", line 172, in create
    return cls(ctx=ctx, config=config)
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/datahub/ingestion/source/unity/source.py", line 124, in __init__
    self.unity_catalog_api_proxy = proxy.UnityCatalogApiProxy(
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/datahub/ingestion/source/unity/proxy.py", line 125, in __init__
    ApiClient(
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/databricks_cli/sdk/api_client.py", line 106, in __init__
    method_whitelist=set({'POST'}) | set(Retry.DEFAULT_METHOD_WHITELIST),
AttributeError: type object 'Retry' has no attribute 'DEFAULT_METHOD_WHITELIST'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/datahub/entrypoints.py", line 182, in main
    sys.exit(datahub(standalone_mode=False, **kwargs))
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/click/core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/click/core.py", line 1657, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/click/decorators.py", line 26, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/datahub/telemetry/telemetry.py", line 379, in wrapper
    raise e
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/datahub/telemetry/telemetry.py", line 334, in wrapper
    res = func(*args, **kwargs)
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/datahub/utilities/memory_leak_detector.py", line 95, in wrapper
    return func(ctx, *args, **kwargs)
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/datahub/cli/ingest_cli.py", line 187, in run
    pipeline = Pipeline.create(
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/datahub/ingestion/run/pipeline.py", line 328, in create
    return cls(
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/datahub/ingestion/run/pipeline.py", line 216, in __init__
    with _add_init_error_context(f"configure the source ({source_type})"):
  File "/usr/local/lib/python3.10/contextlib.py", line 153, in __exit__
    self.gen.throw(typ, value, traceback)
  File "/tmp/datahub/ingest/venv-unity-catalog-0.10.2/lib/python3.10/site-packages/datahub/ingestion/run/pipeline.py", line 121, in _add_init_error_context
    raise PipelineInitError(f"Failed to {step}: {e}") from e
datahub.ingestion.run.pipeline.PipelineInitError: Failed to configure the source (unity-catalog): type object 'Retry' has no attribute 'DEFAULT_METHOD_WHITELIST'
🔍 1
📖 1
l
Hey there 👋 I'm The DataHub Community Support bot. I'm here to help make sure the community can best support you with your request. Let's double check a few things first: ✅ There's a lot of good information on our docs site: www.datahubproject.io/docs, Have you searched there for a solution? ✅ button ✅ It's not uncommon that someone has run into your exact problem before in the community. Have you searched Slack for similar issues? ✅ button Did you find a solution to your issue? ❌ Sorry you weren't able to find a solution. I'm sending you some tips on info you can provide to help the community troubleshoot. Whenever you feel your issue is solved, please react ✅ to your original message to let us know!
d
Hey, thank you for the heads up - I’ll follow up with you in this thread! https://datahubspace.slack.com/archives/C029A3M079U/p1683795418112409