Hi, I've a couple of general questions regarding DataHub: • API's used by DataHubcan only extract the Metadata i.e it will extract the database fields name only and will not extract and store the data inside the fields of database. Is this true? If not, how does this works? • What are the ports that DataHub's services use? Can we manually configure these or is there any list of ports that are available in advance?

Hello Sami, 1.) By default DataHub extracts only metadata information from sources. Some ingestion sources may extract actual data stored in the database for statistical/preview purposes but this is an opt-in feature that must be enabled on each ingestion recipe. See: https://datahubproject.io/docs/metadata-ingestion/docs/dev_guides/sql_profiles 2.) By default DataHub GMS (the backend) uses port 8080, while the frontend uses 9002. You can configure ports at will.

In our Troubleshoot section of our Quickstart Guide there's a section called "Port Conflicts" - if you expand that you can see all of the default ports datahub uses and advice on how to set custom ports in case of conflicts https://datahubproject.io/docs/quickstart#troubleshooting-issues

Note that this troubleshooting section is for DataHub deployed using our cli which under the hood launches a docker-compose deployment in your local machine. For K8s the ports are the same by default unless there is some component (say the SQL database or Elastic) that you manage yourself, in that case you need to adjust accordingly.

Hey, thanks a ton folks. I'm extremely grateful for the help.