https://datahubproject.io logo
Join Slack
Powered by
```~~~~ Execution Summary - RUN_INGEST ~~~~ Execut...
# advice-metadata-modeling
l
Copy code
~~~~ Execution Summary - RUN_INGEST ~~~~
Execution finished with errors.
{'exec_id': '7741f040-bc32-4b90-9182-bd273621ab7e',
 'infos': ['2023-05-04 16:58:30.727353 INFO: Starting execution for task with name=RUN_INGEST',
           "2023-05-04 16:58:34.832761 INFO: Failed to execute 'datahub ingest'",
           '2023-05-04 16:58:34.832922 INFO: Caught exception EXECUTING task_id=7741f040-bc32-4b90-9182-bd273621ab7e, name=RUN_INGEST, '
           'stacktrace=Traceback (most recent call last):\n'
           '  File "/usr/local/lib/python3.10/site-packages/acryl/executor/execution/default_executor.py", line 122, in execute_task\n'
           '    task_event_loop.run_until_complete(task_future)\n'
           '  File "/usr/local/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete\n'
           '    return future.result()\n'
           '  File "/usr/local/lib/python3.10/site-packages/acryl/executor/execution/sub_process_ingestion_task.py", line 231, in execute\n'
           '    raise TaskError("Failed to execute \'datahub ingest\'")\n'
           "acryl.executor.execution.task.TaskError: Failed to execute 'datahub ingest'\n"],
 'errors': []}

~~~~ Ingestion Logs ~~~~
Obtaining venv creation lock...
Acquired venv creation lock
venv setup time = 0
This version of datahub supports report-to functionality
datahub  ingest run -c /tmp/datahub/ingest/7741f040-bc32-4b90-9182-bd273621ab7e/recipe.yml --report-to /tmp/datahub/ingest/7741f040-bc32-4b90-9182-bd273621ab7e/ingestion_report.json
[2023-05-04 16:58:33,369] INFO     {datahub.cli.ingest_cli:165} - DataHub CLI version: 0.10.0
[2023-05-04 16:58:33,395] INFO     {datahub.ingestion.run.pipeline:179} - Sink configured successfully. DataHubRestEmitter: configured to talk to <http://datahub-datahub-gms:8080>
Failed to configure the source (datahub-business-glossary): 1 validation error for BusinessGlossarySourceConfig
file
  file or directory at path "cristina.narros/testterms.yml" does not exist (type=value_error.path.not_exists; path=cristina.narros/testterms.yml)
l
Hey there 👋 I'm The DataHub Community Support bot. I'm here to help make sure the community can best support you with your request. Let's double check a few things first: 1️⃣ There's a lot of good information on our docs site: www.datahubproject.io/docs, Have you searched there for a solution? Yes button 2️⃣ It's not uncommon that someone has run into your exact problem before in the community. Have you searched Slack for similar issues? Yes button
b
Can share recipe? Is the relative path of tml file to recipe correct?
l
The problem is that I have hosted Datahub in Azure, how can I tell it to take a file from my local computer?
source: type: datahub-business-glossary config: file: 'C:\Users\cristina.narros\testterms.yml' enable_auto_id: true
or where do I have to place the .yml file inside the AKS so that it does not fail?
b
you cannot refer to local file in ui ingestion, AFAIK
need to run CLI ingestion on local comp, or put your file in some URL , to be picked up by UI ingest
l
How can I put the file in a url or do the ingest via cli, DataHub is in an AKS?
b
How can I put the file in a url => git repo etc ingest via cli => https://datahubproject.io/docs/cli => then point the sink to the GMS hosted in AKS (ingress to GMS or proxy via <frontend-url>/api/gms
a
Thanks for the help xL! Cristina let me know if this is still affecting you after following that doc!
Open in Slack
PreviousNext
Powered by