When this happened, number of open connections ballooned dramatically. And then we got a page and the entire huge cluster needs to be restarted.
g
Gian Merlino
08/02/2023, 3:42 AM
wow, that's odd…
Gian Merlino
08/02/2023, 3:43 AM
are you suggesting that there is some condition where the Jetty threads get wedged and never return?
Gian Merlino
08/02/2023, 3:43 AM
If so, do you have a thread dump of a server that's in this state? Would like to see what stuff is stuck doing
d
Didip Kerabat
08/17/2023, 2:24 AM
Sorry for the late reply.
Yes sir, there is a rare condition (but a large cluster will hit it eventually) where Jetty threads get wedged and never returned.
I will try to get the thread dump next time.
Whenever this happened it always becomes a high priority ticket so we were always rushing to restart the cluster.