Hi all! I want to ask something about how to inges...
# ingestion
d
Hi all! I want to ask something about how to ingest metadata automatically. I ingest hive source using
datahub ingest -c hive_to_rest.yml
. But when my data updated in hive, I need to run the command again to update the metadata in datahub? If I want continuous update once ingested, what should I do?
g
Hey there, this thread may be helpful for you: https://datahubspace.slack.com/archives/CUMUWQU66/p1635964365200100
d
Oh, I see. It means I can start a timed task to automatically ingest metadata with airflow, right?
g
Right, exactly. You would run ingestion at a regular cadence via airflow, cron, or some other scheduler.
d
Ok, thank you very much