A complete solution for open data platforms, enterprise data catalogs, data lakes and data management. Open source, mature, fully-featured and production ready.

DataHub

Hi team - I started ingesting data from confluent cloud kafka but it seems to be super slow to ingest the data. Here is an example. You can see it takes about 2 mins per topic which is not scalable for us
```[2022-01-03 13:44:47,679] INFO     {datahub.cli.ingest_cli:81} - Starting metadata ingestion
[2022-01-03 13:47:19,428] INFO     {datahub.ingestion.run.pipeline:77} - sink wrote workunit kafka-&lt;topic1&gt;
[2022-01-03 13:49:50,867] INFO     {datahub.ingestion.run.pipeline:77} - sink wrote workunit kafka-&lt;topic2&gt;```

Nevermind, it was because of retries to schema registry which was not reachable from my laptop