Hi I'm new to datahub. I want to know how metadata is extracted from source (Ex: hive).

Hello Mani, What in particular would you like to know? Datahub has some documentation on how it works that you can check out at: https://datahubproject.io/docs/metadata-ingestion

@incalculable-ocean-74010 I want to know logic of how metadata is extracted from hive. I want know what happens in the hive when i run datahub ingest for hive

The metadata ingestion framework connects to hive based on the configurations you provide using SQLAlchemy. The framework then executes SQL commands to extract metadata information which is then converted into MCE objects that datahub consumes. The hive connector in particular extracts the following info (as per the documentation:

This plugin extracts the following:

Metadata for databases, schemas, and tables
Column types associated with each table
Detailed table and storage information
Table, row, and column statistics via optional SQL profiling