I built the DataHub metadata ingestion client into...
# ingestion
m
I built the DataHub metadata ingestion client into an image and started the container to ingest the metadata. It took about 5 minutes before each ingestion started. How should I optimize it
b
even though i wrote it to "file" sink, I find that ingestion starts faster if i run
datahub telemetry disable
before i run
datahub ingest -c xx
, maybe it helps for you?
m
In this case, I need to perform the metadata ingestion twice. The ingestion process is not slow, but the ingestion started slowly. I wonder if anyone knows or has done any tests on the client container. It would be nice to have some tuning parameters for the client container