Based on a thread from a few days ago, I changed our Pinot deployment from 6 controllers to 3. Now I am seeing three controllers as "dead" in Cluster Manager, and I am getting

segments ... unavailable

errors (though I am not sure these two issues are related 1. How do I get rid of "dead" controllers when I reduce the number of controllers? 2. Could this cause

segment ... unavailable

?

For 2, could you share the output of debug api (from swagger)?

For 2, the segments eventually changed to a good state - I think I had not given the severs enough time to recover after restarting (for something else). So (1) is not related to (2) - but I would still like to fix (1)

Can you paste the screenshot for 1)?

image.png

You can check if there's any reference of the removed controllers in the

CONTROLLER

,

INSTANCES

or

LIVEINSTANCES

nodes. If not, then this may be a UI issue.

There are references in INSTANCES but not LIVEINSTANCES

Thanks @Tony Requist, could you file a GH issue (with as much info as you can in terms of symptoms and repro steps)?

Will do