A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Hi Team , I am in process of doing some test around semi-structured data such as CSV or Parquet files, Can someone help me please how to do perform ingestion for semi-structured data  and some documentation around it?

Hello Rajesh,

You can take a look at the source code associated with the <https://datahubproject.io/docs/metadata-ingestion/source_docs/data_lake|data lake ingestion source>. The source can be found <https://github.com/datahub-project/datahub/tree/master/metadata-ingestion/src/datahub/ingestion/source/data_lake|here>.