This message was deleted.
# troubleshootings
Slackbot
09/27/2022, 12:39 PMThis message was deleted.
i
Ian Roberts
09/27/2022, 12:43 PMIf the data is in deep storage, it should load as per the rules. Do you see the load queues taking on the segments or do you see in the logging if the older segments are being loaded?
r
Rohit
09/27/2022, 2:23 PM@Ian Roberts I am not sure how to check, i am running query to validate this where i am still not able to older date data after extending retention.
i
Ian Roberts
09/27/2022, 2:44 PMCheck your coordinator log to see if it is assigning segments to historicals. Depending on when you changed the retention settings, it can take time to load the older segments. You can also check the segments tab to find the earliest timestamp of the loaded segments
g
Gian Merlino
09/27/2022, 4:24 PMOnce it's marked unused (by drop rules) it will not automatically be marked used even if you change the rules
i
Ian Roberts
09/27/2022, 4:32 PMinteresting, so the metadata still will have it marked as unused?
g
Gian Merlino
09/27/2022, 4:39 PMyeah, automated marking only goes one way
Gian Merlino
09/27/2022, 4:39 PMonce it's been marked unused automatically, you can mark it used manually, as long as you haven't done a permanent deletion yet through kill task (https://druid.apache.org/docs/latest/data-management/delete.html#permanently-kill-task) or autokill
Gian Merlino
09/27/2022, 4:41 PMIIRC there's an action in the web console to re-mark a certain time interval as used
Gian Merlino
09/27/2022, 4:42 PMthere is also an API for it of course; you can do it by interval or for an entire datasource
i
Ian Roberts
09/27/2022, 4:44 PMThank you!
r
Rohit
09/27/2022, 6:16 PMThanks, these are very helpful inputs. i couldn't find any option in UI where i could mark it as used manually, segments are still available in s3 location. also, to confirm i don't see segments in the date range which i extended, so i believe it has to be marked manually which i am trying to figure out an option in UI or how to submit through an Api. Any suggestions please. cc @Gian Merlino @Ian Roberts
v
Vadim
09/27/2022, 7:25 PMIn the datasources view you can mark segments as used
Vadim
09/27/2022, 7:27 PMAlso be aware that you are on a fairly old Druid version (notice how my screenshot is blueish and yours is greenish), the UI evolved a ton so it is possible some options that people suggest via screenshots (like I did) might not be in the same place for you (or might not exist)
r
Rohit
09/27/2022, 8:06 PMgreat, thanks for recommending, i will propose to move to latest internally. i was able to set interval as 2022-08-25T000000.00/2022-09-13T000000.00. However, i see only 1 day data got loaded which was of 12th since more than 30 mins. in coordinator node, i see an error, not sure if that has caused it not to reload-
Copy code
2022-09-27T15:27:54,368 WARN [ServerInventoryView-0] org.apache.druid.curator.inventory.CuratorInventoryManager - Exception while getting data for node /test-druid-base/druid/segments/stats-druid-historical-1.test-druid-historical.test-uat.svc.cluster.local:8083/test-druid-historical-1.test-druid-historical.test-uat.svc.cluster.local:8083_historical_tier1_2022-09-27T15:24:57.586Z_142b7f8576e44979a4c787f0f6472dbe230
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /test-druid-base/druid/segments/test-druid-historical-1.test-druid-historical.test-uat.svc.cluster.local:8083/test-druid-historical-1.test-druid-historical.test-uat.svc.cluster.local:8083_historical_tier