A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

To ingest metadata from hive, I can see from UI ingestion or from yml file. If we want to write some crawler, Is there any guide or documents regarding that ? 

I can see we can use java and python emitters also 

Hi <@U040ZH9D3QD>, is there a reason why you want to write a crawler yourself and not use the out of the box hive source?

Hi <@U028L1V9BE1> , I was just curious to know , so that if I want to add any additional metadata I can do it . 

And also to get more code level info of the inbuilt crawler , can you tel me the classes where I can look into? 

Hi <@U040ZH9D3QD>, you could take a look at <https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/src/datahub/ingestion/source/sql/hive.py|this>.

Thank you <@U028L1V9BE1> , I will have a look at it. 