Hi Everyone, I just set up the quickstart install for redshift and I've added my first source but the ingest failed. It seems like one or more of the containers comes with python 3.10 which isn't compatible with acryl-datahub.

ERROR: Could not find a version that satisfies the requirement acryl-datahub[datahub-kafka,datahub-rest,redshift]==@cliMajorVersion@ 

Execution finished with errors.
{'exec_id': 'f7a40783-a3ea-4c35-8161-47f449c22e4b',
 'infos': ['2023-09-08 16:58:42.877515 INFO: Starting execution for task with name=RUN_INGEST',
           "2023-09-08 16:58:55.261806 INFO: Failed to execute 'datahub ingest'",
           '2023-09-08 16:58:55.264998 INFO: Caught exception EXECUTING task_id=f7a40783-a3ea-4c35-8161-47f449c22e4b, name=RUN_INGEST, '
           'stacktrace=Traceback (most recent call last):\n'
           '  File "/usr/local/lib/python3.10/site-packages/acryl/executor/execution/default_executor.py", line 122, in execute_task\n'
           '    task_event_loop.run_until_complete(task_future)\n'
           '  File "/usr/local/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete\n'
           '    return future.result()\n'
           '  File "/usr/local/lib/python3.10/site-packages/acryl/executor/execution/sub_process_ingestion_task.py", line 231, in execute\n'
           '    raise TaskError("Failed to execute \'datahub ingest\'")\n'
           "acryl.executor.execution.task.TaskError: Failed to execute 'datahub ingest'\n"],
 'errors': []}

any easy way this can be fixed? I'm not even sure which container this is coming from. Thanks for any help.

Are you just running with quickstart? It seems like our

@cliMajorVersion@

placeholder isn't getting substituted, but I've never seen that before

I ran into the same error and need to pip install acryl-datahub[datahub-kafka,datahub-rest,redshift] outside the container everytime

thank you, yes it was the quickstart. I will try that pip install.

I’m having the same issue here - https://datahubspace.slack.com/archives/C029A3M079U/p1694787611099299. @brave-dinner-42003 what do you mean by “pip install … outside the container”? Can you provide some more detail for where specifically you needed to install those packages to get it to work? I tried installing it in the Datahub Actions container but that didn’t seem to resolve it for me. And @elegant-machine-46829 what did you force to upgrade, and how did you force whatever that is to upgrade?