https://datahubproject.io logo
#troubleshoot
Title
# troubleshoot
h

helpful-painting-48754

06/14/2022, 7:28 AM
Hi all, I tried to enable data profiling while ingesting from TiDB. I got an error saying that
Copy code
['Profiling exception 5:00:00 is of type timedelta which cannot serialized.'],\n"
Is this due to the data type not being compatible?
plus1 1
b

bulky-soccer-26729

06/14/2022, 3:34 PM
would you mind providing the full stack trace if you have it?
h

helpful-painting-48754

06/15/2022, 1:22 AM
Copy code
Traceback (most recent call last):\n'
           '  File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/default_executor.py", line 121, in execute_task\n'
           '    self.event_loop.run_until_complete(task_future)\n'
           '  File "/usr/local/lib/python3.9/site-packages/nest_asyncio.py", line 89, in run_until_complete\n'
           '    return f.result()\n'
           '  File "/usr/local/lib/python3.9/asyncio/futures.py", line 201, in result\n'
           '    raise self._exception\n'
           '  File "/usr/local/lib/python3.9/asyncio/tasks.py", line 256, in __step\n'
           '    result = coro.send(None)\n'
           '  File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/sub_process_ingestion_task.py", line 115, in execute\n'
           '    raise TaskError("Failed to execute \'datahub ingest\'")\n'
b

bulky-soccer-26729

06/15/2022, 2:00 PM
hmm gotcha. yeah I'm not exactly sure what's going on, but a timedelta is obviously trying to be serialized which is not accepted, maybe it's expecting an int? you could potentially disable the columns from profiling where it fails to quick fix this
h

helpful-painting-48754

06/16/2022, 1:40 AM
Hi Collins, may i know how to disable the columns in the yaml file?
9 Views