Hello, We have DataHub v.0.8.44 deployed via Helm to EKS cluster. The very first ingestion we’d like to have is Redshift, so the AWS-part was done beforehand: connectivity, roles, policies etc. After adding the secret for Redshift readonly user and filling the connection wizard, we get the error:

~~~~ Execution Summary ~~~~

RUN_INGEST - {'errors': [],
 'exec_id': 'b40bc26a-28d8-46cd-a6ee-14e0397cbd40',
 'infos': ['2022-09-19 09:07:33.274446 [exec_id=b40bc26a-28d8-46cd-a6ee-14e0397cbd40] INFO: Starting execution for task with name=RUN_INGEST',
           '2022-09-19 09:07:33.276286 [exec_id=b40bc26a-28d8-46cd-a6ee-14e0397cbd40] INFO: Caught exception EXECUTING '
           'task_id=b40bc26a-28d8-46cd-a6ee-14e0397cbd40, name=RUN_INGEST, stacktrace=Traceback (most recent call last):\n'
           '  File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/default_executor.py", line 121, in execute_task\n'
           '    self.event_loop.run_until_complete(task_future)\n'
           '  File "/usr/local/lib/python3.9/site-packages/nest_asyncio.py", line 89, in run_until_complete\n'
           '    return f.result()\n'
           '  File "/usr/local/lib/python3.9/asyncio/futures.py", line 201, in result\n'
           '    raise self._exception\n'
           '  File "/usr/local/lib/python3.9/asyncio/tasks.py", line 256, in __step\n'
           '    result = coro.send(None)\n'
           '  File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/sub_process_ingestion_task.py", line 71, in execute\n'
           '    validated_args = SubProcessIngestionTaskArgs.parse_obj(args)\n'
           '  File "pydantic/main.py", line 521, in pydantic.main.BaseModel.parse_obj\n'
           '  File "pydantic/main.py", line 341, in pydantic.main.BaseModel.__init__\n'
           'pydantic.error_wrappers.ValidationError: 1 validation error for SubProcessIngestionTaskArgs\n'
           'debug_mode\n'
           '  extra fields not permitted (type=value_error.extra)\n']}
Execution finished with errors.

Any ideas what’s wrong with the validation? There are basically only three fields (endpoint, user, secret).

Hi @brief-ability-41819 which version of datahub-actions container are you using ? If you are on older version (v0.0.4), please upgrade to v0.0.6 to fix this.

Indeed, it’s v0.0.4. I’ll upgrade to v0.0.6 and update the thread once it’s done. Thanks for the hint!

@hundreds-photographer-13496: Thank you for your support! Now we can progress further with our project! 🥳