What’s the latest thinking around the coordinator scaling and the number of segments per time chunk? A while back, there was some guidance that around 2000 segments per timechunk was the ideal number and we’d sized our ingest granularity accordingly.
But I know the coordinator is so much more performant in newer releases and wondered if that guidance still held.
g
Gian Merlino
05/07/2025, 3:13 PM
It is more performant now and it is possible to have more. The main thing that changed was the efficiency of the balancing algorithm. There's a hard limit of 32k per time chunk, though, so don't get too close to that