A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Hi, 
I was integrating hive with datahub and ingesting metadata from UI, but I can see the partition Column Info is not present, I checked the code , it's written in code that if the row contain partition information, the loop breaks in hive.Py . May I know the reason behind this ? 

Basically all the info in the describe formatted of the hive table is present , but not the #partition information

Hi <@U040ZH9D3QD> You are right that hive partition information is currently not ingested in DataHub. The break in the loop has nothing much to do with it. That code only gets list of all columns from table. Additional code needs to be written to parse partition information and ingest that into DataHub.

Thanks for the reply <@U02G4B6ADL6> . Is the partition Info ingestion is in progress or any issue open for it ? 

This is related - <https://feature-requests.datahubproject.io/p/advanced-dataset-schema-properties-partition-support>