This message was deleted.
# troubleshooting
s
This message was deleted.
d
There is a heartbeat http call that checks for historical’s liveliness.
if using ZK, the ZK client provides the liveliness check.
when it’s down temporarily, then broker will ask coordinator where is the other replica. when it’s down for longer time, I believe there’s a flagging system that mark the node as down. Then coordinator’s background thread will pick another historical and starts a new replication process. This is just in the nutshell. Others know much more than me.
p
thanx @Didip Kerabat! Do you know how is this
then broker will ask coordinator where is the other replica
happening? How does the broker know to ask that?
g
slight correction— Broker will ask either ZK, or the historicals directly, depending on whether you use ZK or HTTP based segment announcing
in particular— Coordinator tells Historicals which segments to load, and Broker gets that info from ZK or HTTP calls to Historicals, depending on what kind of segment announcing you use. Recently the default changed to HTTP, so if you use the current version of Druid it'll be HTTP
hope this answers your question
p
thanx @Gian Merlino! I'm still a bit not sure about the timings. we use ZK. So lets say some historical goes down at 19:00, and after 10 seconds it's records disappear from ZK. When will the broker get to know it? I guess it doesn't fetch the segments info from ZK for each query - but rather periodically. So how frequent is it? Can it be controlled?
g
the Broker uses ZK watches to stay in sync, so it will know about the update almost immediately after ZK does
🙏 1