https://datahubproject.io logo
Join Slack
Powered by
Hi Team Facing the following issue while executing...
# troubleshoot
n
Hi Team Facing the following issue while executing the ingestion pipeline through UI
Copy code
~~~~ Execution Summary ~~~~

RUN_INGEST - {'errors': [],
 'exec_id': 'bcaca377-5b8d-4957-bca5-74e68bf71e3d',
 'infos': ['2022-12-08 05:46:36.817335 [exec_id=bcaca377-5b8d-4957-bca5-74e68bf71e3d] INFO: Starting execution for task with name=RUN_INGEST',
           '2022-12-08 05:46:36.921081 [exec_id=bcaca377-5b8d-4957-bca5-74e68bf71e3d] INFO: Caught exception EXECUTING '
           'task_id=bcaca377-5b8d-4957-bca5-74e68bf71e3d, name=RUN_INGEST, stacktrace=Traceback (most recent call last):\n'
           '  File "/usr/local/lib/python3.10/site-packages/acryl/executor/execution/default_executor.py", line 123, in execute_task\n'
           '    task_event_loop.run_until_complete(task_future)\n'
           '  File "/usr/local/lib/python3.10/asyncio/base_events.py", line 646, in run_until_complete\n'
           '    return future.result()\n'
           '  File "/usr/local/lib/python3.10/site-packages/acryl/executor/execution/sub_process_ingestion_task.py", line 73, in execute\n'
           '    SubProcessTaskUtil._write_recipe_to_file(exec_out_dir, file_name, recipe)\n'
           '  File "/usr/local/lib/python3.10/site-packages/acryl/executor/execution/sub_process_task_common.py", line 105, in '
           '_write_recipe_to_file\n'
           '    os.makedirs(dir_path, mode = 0o777, exist_ok = True)\n'
           '  File "/usr/local/lib/python3.10/os.py", line 215, in makedirs\n'
           '    makedirs(head, exist_ok=exist_ok)\n'
           '  File "/usr/local/lib/python3.10/os.py", line 225, in makedirs\n'
           '    mkdir(name, mode)\n'
           "PermissionError: [Errno 13] Permission denied: '/tmp/datahub/ingest'\n"]}
Execution finished with errors.
Can someone please help me out
✅ 1
@little-megabyte-1074 @dazzling-judge-80093
@better-orange-49102 @gray-shoe-75895 @big-carpet-38439
a
Hi @numerous-account-62719, could you try updating your 
datahub-actions
container? Also in the future, please refrain from @’ing a bunch of users- we’re scanning actively to address issues and @’ing just creates more noise!
n
Sure, what to update in datahub-actions?
@astonishing-answer-96712??
d
datahub-action container
n
but what should I update?
it is already in newest version
d
can you then kill the action pod and recreate it? This permission denied should not happen.
h
Hey @numerous-account-62719 were you able to get past this ?
n
No Not yet
h
have you already tried the advice from Tamas ?
r
Looks like i have the same issue, but i'm using 9.0.0
Installed datahub-actions v0.0.10 version, still the same issue. This error i can see in UI and in datahub-actions pod logs
Maybe it's openshift specific, but i don't think so. Probably somewhere need additional permissions 😄
n
I have tried the advice from tamas @hundreds-photographer-13496
h
and did it work ? Are you using RHEL/openshift ?
r
As i understand problem is with /tmp directory itself. The problem is that datahub user inside container running with 100 UID. When you set up custom UID via values.yaml in securityContext, for example: 1000990000, user datahub don't have permissions to access /tmp. If you running with root permissions everything works, because datahub have permissions to act as a root
If you forgot to add custom UID for example: 1000990000, openshift default UID range is not from 100 or 1000.
What you can do? Probably before initial launch of container you can run entrypoint commands to change folder ownership. I will try this.
n
Okay @rough-flag-51828 Please let me know about it @hundreds-photographer-13496 It did not work I am using OpenShift
@rough-flag-51828 Have you tried it?
h
Hi @numerous-account-62719 and @dazzling-judge-80093 I am getting the same issue, with 
acryldata/datahub-actions:v0.0.11
did you found any kind of solution?
r
@hallowed-analyst-96384 I will check it, but what i done i just launched datahub on VM ... Sadly, but for openshift was too consuming 😄
I mean time consuming.
h
Yup that would't even be an option for me unfortunately😅
r
You running on openshift or kubernetes?
And also question is it cloud or on-premise?
h
Kubernetes, that's why I said it's not an option because it's a production deployment
r
Ah so it's a little bit simpler
This error occurs because of permissions on that /tmp catalog
So probably you need to rebuild image of datahub and implement changes
I mean rebuild with new Dockerfile take image newest datahub and add permissions to that catalog
h
Yes, I see this would be a good option probably. Thanks
I actually found out what was the issue in my case. For anyone else, please check the 
podSecurityContext
if you set any, in my case the values were 101 instead of 102
a
Hello @hallowed-analyst-96384 @rough-flag-51828 could you please give me some precise hints on how did you solve the problem? I have set in my helm values file: acryl-datahub-actions.securityContext.runAsUser = '1000990000' acryl-datahub-actions.podSecurityContext.runAsUser = '1000990000' acryl-datahub-actions.securityContext.fsGroup = '1000990000' But I still have the same error. Did you change something in dockerfile of datahub-actions to change file owner?
Open in Slack
PreviousNext
Powered by