when I used to manage a large druid cluster with many varied users on it, I'd approach this by doing a canary deploy and watching for any increase in errors or performance degradations
Gian Merlino
09/27/2022, 3:51 AM
like: deploy one or two new historicals & one or two new MMs, check in on their error rates and performance after about a day
Gian Merlino
09/27/2022, 3:51 AM
if looks good then update the rest of the data servers
Gian Merlino
09/27/2022, 3:51 AM
then repeat with a canary broker
d
Didip Kerabat
09/27/2022, 6:35 PM
ho… interesting. I guess I can replicate this on Kubernetes, just add 10% extra pods with the new Druid version and observe the error rate.