A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Does Datahub allow ingestion of metadata from salesforce, powerBI and talend (etl)?

Not without some work on the python ingestion framework.

how difficult is it to work on python ingestion framework? Is it not possible to push using APIs?

Sure you can push through the API. The more labor-intensive side is "crawling" your powerBI dashboards and convert that metadata into the format that the Datahub REST API understands.

The ingestion framework itself is super simple to work with, all the scaffolding is in place. the difficulty comes from the source: how easy is it to get and mangle the metadata you need?

Did you try this kind of ingestion anytime?

Yes, I implemented the LookML and Looker dashboard "sources" in the framework

Thanks <@U01AFJB5M9C> - <@U025S6PRF88> I can also help answer any questions as you take a look at the ingestion framework

Thank you..will reach you for any questions

One question can we install datahub without docker..we are planning to perform a POC for customer

maybe <@U01NN9CTQ01> can answer this better, but I think it's going to require a lot of manual work to set up all the different services without using docker. If a local instance running on a laptop is enough for the PoC, then running the `quickstart.sh`  command is really super easy, but it does require docker and docker-compose.

Yes! And we recently improved the datahub cli for quickstart purposes. Install latest version and run `datahub docker quickstart`. If you have a kubernetes cluster, you can also quickstart there using our helm charts as well.