Hello Team , How do i ingest only the changes in m...
# ingestion
b
Hello Team , How do i ingest only the changes in metadata to datahub
o
Currently our ingestion works on full upserts. To get only the changes, in your ingestion pipeline you would want to do a read-modify-write where you pull the current model, modify the specific fields you want to modify, and then write back to DataHub. Most of our ingestion scripts work by pulling the full set of metadata from sources every time.