Apache Druid

Apologies for not answering your question directly, but one thing you might consider is switching to http based task announcement. It is specifically designed to make concerns of znode size a thing of the past. The setting `druid.indexer.runner.type=httpRemote` is considered to be experimental as of the current release although in the upcoming 25 release (the RC for it is about to come out!) it will be the default. See <https://github.com/apache/druid/pull/13092> . I can tell you that we have been testing `httpRemote` extensively at Imply and it is the bee's knees.

Is there a significant delta between functionality/bugfixes for httpRemote between 24.0.1 and 25 (besides it being default)? looking through the closed PRs on the repo seems to suggest the answer is no. I'd be open to switching to that if there wasn't a lot of drift

to the best of my knowledge: no. It has actually been pretty stable for a while. We just had a hard time finding the person-power to push it into stable (like update the docs and stuff). The reason it is happening now is that MSQ is going GA and MSQ tends to make these huge task payloads so this really helps

Ok that makes sense. I can give this a try. Thanks!