This message was deleted.
# generals
Slackbot
06/01/2023, 10:56 AMThis message was deleted.
b
Bibek Sahoo
06/01/2023, 11:24 AMYes you can reindex a time window smaller than segment granularity but complete data for that hour will be replaced with the 1 minute data that you were reindexing.
Bibek Sahoo
06/01/2023, 11:26 AMFor example if you have a day granularity data and reindexing a specific hour then your day segment will gets replaced with one hour of data(segment granularity day)
Bibek Sahoo
06/01/2023, 11:27 AMif you have hour granularity data for 24 hours (24 segments) and you are reindexing specific hour then only that segment for the specific hour will get replaced.
Bibek Sahoo
06/01/2023, 11:33 AMMay be we can reindex the complete data first into minute interval and then reindex the specific minute and then reindex back to hour.
r
Roger Gabarit
06/01/2023, 12:00 PMOK, so for the time being you would advise to reindex the complete hour and add the appropriate minute I want to drop in the filter with __time=x I guess ?
b
Bibek Sahoo
06/01/2023, 12:15 PMYes, you could try that to drop specific records
j
John Kowtko
06/01/2023, 2:25 PMYou can also ingest a new segment with 1 MINUTE granularity in OVERWRITE mode (appendToExisting=false) ... that one minute segment will overshadow your existing HOUR segment, and the queries will see the correct "latest" version of all data across that hour.
You do not need to match segment granularities when you are using overwrite mode.
The caveat is that you cannot create a new segment with no data in it (unless you create a tombstone segment, but I don't know if that can be created on its own.) ... so you may have to ensure that you have at least one record of data to insert into that new segment. I believe based on your original question (you are deleting data related to only one dimension) that there will be other data in that minute interval ... so you should be okay.