Hi, Can i ask what is the default mechanism of met...
# ingestion
g
Hi, Can i ask what is the default mechanism of metadata ingestion , either over Kafka or Rest ?
m
I would say during development, use Rest, that way you get instant feedback if your ingestion failed. In production use Kafka to decouple your metadata production from DataHub.
g
Could we get Kafka off the DataHub ? We have already Rest for doing the job. What is Kafka using for ?
a
@glamorous-kite-95510 Well, I think using Kafka enables you to recover from failure and you can even bootstrap from Kafka logs.