A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Hi all, I tried to enable data profiling while ingesting from TiDB. I got an error saying that
```['Profiling exception 5:00:00 is of type timedelta which cannot serialized.'],\n"```
Is this due to the data type not being compatible?

would you mind providing the full stack trace if you have it?

```Traceback (most recent call last):\n'
           '  File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/default_executor.py", line 121, in execute_task\n'
           '    self.event_loop.run_until_complete(task_future)\n'
           '  File "/usr/local/lib/python3.9/site-packages/nest_asyncio.py", line 89, in run_until_complete\n'
           '    return f.result()\n'
           '  File "/usr/local/lib/python3.9/asyncio/futures.py", line 201, in result\n'
           '    raise self._exception\n'
           '  File "/usr/local/lib/python3.9/asyncio/tasks.py", line 256, in __step\n'
           '    result = coro.send(None)\n'
           '  File "/usr/local/lib/python3.9/site-packages/acryl/executor/execution/sub_process_ingestion_task.py", line 115, in execute\n'
           '    raise TaskError("Failed to execute \'datahub ingest\'")\n'```


hmm gotcha. yeah I'm not exactly sure what's going on, but a timedelta is obviously trying to be serialized which is not accepted, maybe it's expecting an int? you could potentially disable the columns from profiling where it fails to quick fix this

Hi Collins, may i know how to disable the columns in the yaml file?