When making the connections to pinot brokers via vip, the connection can be stale if the broker is changed. How can you solve this problem?

Hmm, vip is outside of Pinot, it it is holding on to stale connections, that is something on the vip side. Typically we use load-balancers (elb) for this purpose.