This message was deleted.
# generals
Slackbot
12/09/2022, 12:20 PMThis message was deleted.
j
Jonathan Du
12/09/2022, 12:31 PMI think the type of retention you want is
dropBeforeByPeriodk
Karan Kumar
12/09/2022, 3:16 PMYou would need to have a dop rule as well.
https://druid.apache.org/docs/latest/operations/rule-configuration.html
Karan Kumar
12/09/2022, 3:17 PMIf the documentation is unclear do let us know. We are always looking for feedback on it.
Karan Kumar
12/09/2022, 3:17 PM🚀
s
Siddharth Shirish Nahar
12/12/2022, 5:58 AMCan you clarify on includeFuture flag with an example ? How it is used ?
Siddharth Shirish Nahar
12/12/2022, 11:42 AMSo, I am working on different cubes with retention rules as loadByPeriod + dropForever. I am seeing segments loading correctly for some and some cubes are not following the rules.
Siddharth Shirish Nahar
12/12/2022, 11:42 AMCan it be the case data is loaded in cache and is unable to clear it or there is some other issue ?
k
Karan Kumar
12/13/2022, 12:00 PMSo I generally look at the coordinator logs to figure out issues here and the kill task logs
s
Siddharth Shirish Nahar
12/13/2022, 12:14 PMOhk, Is there anyway to reset cache and reload all segments according to retention rules ?
k
Karan Kumar
12/13/2022, 12:16 PMI donot know what you mean by reset cache. By cache I mean you are talking about the historical cache
s
Siddharth Shirish Nahar
12/15/2022, 7:47 AMYes, Historical cache
k
Karan Kumar
12/24/2022, 11:35 AMJust kill the historical, clear the segment cache location manually and then start the historical again
Karan Kumar
12/24/2022, 11:38 AMJust a note that there may be segment unavailability while segments are downloaded from deep storage. Hence, please take the necessary precautions. Maybe try it in a non prod cluster first