Slackbot
08/07/2023, 8:06 AMSamarth Jain
08/07/2023, 8:12 AM20230101
20230102
20230103
Now, consider a scenario where the new data is written to the source for the following dates
20230101
20230103
and deleted for
20230102
Now when batch ingestion is run again in overwrite mode, Druid datasource will have data for:
20230101 (new)
20230102 (old)
20230103 (new)
What we would like is a behavior where if data was ingested specifying the interval as
2023-01-01/2023-01-03
then, if there is no data in the source for any date (in this case 20230102), then the data for the corresponding date is deleted from the Druid datasource.Abhishek Agarwal
08/07/2023, 8:31 AMSamarth Jain
08/07/2023, 9:50 AMAbhishek Agarwal
08/07/2023, 10:06 AMAbhishek Agarwal
08/07/2023, 10:13 AM