This message was deleted.
# troubleshooting
s
This message was deleted.
n
When the coordinator is restarted, it takes some time for it to learn about all the segments in metadata and various other things. Depending on how many segments you have in your metadata, this can last for tens of minutes (up to an hour if you're talking millions of segments). If you enable debug logging, you can see this happening in the logs...
s
In that mean, will the ingestion and other application queries work proper?
v
FYI, in Druid 25 there were changes made to the console so it works better when the coordinator is being restarted
🔥 1
s
okay, but my point is, will there be any impact during the UI is stuck ?
g
if the time period is not too long (a few minutes) everything will be 100% fine. if it's very long (tens of minutes/hours) then you may have issues with delayed handoff from ingest tasks, and delayed rebalancing of historicals (in the case where rebalancing is needed).
we're working on improving these latter cases for very large clusters with very large numbers of segments; if you're in these cases let us know! we may be able to suggest fixes to any particular issues you're having, and we're also always interested in feedback from people that run very large clusters
s
Thanks @Gian Merlino
@Gian Merlino, I am stuck with a different issue, where Druid is unaware of HA on deep storage HDFS, when ever we switch namenode, we are doing change in middle managers to change /etc/hosts with name node as current active.. Is there a better way to handle this?
g
hmm, do you have HA configured in
hdfs-site.xml
for your hadoop install generally?
if so you could put this in your
_common
druid config directory
It should get picked up by the extension