Are there any guides for sizing pinot, e.g. number of servers, brokers, controllers. Seems my setup has stopped working well with most queries only getting a response from one server instead of expected 2. I have added memory to servers, clustered zookeeper, ran recommendation engine for tables but seems not much is making a good improvement.

i have the same question! i tried throwing more resources at my brokers/servers, but the cpu/mem utilization on grafana looks like it will not help

Hi 👋 - it would be interesting to get a cpu profile by installing async-profiler as a native agent as outlined here, setting

-agentpath:/path/to/libasyncProfiler.so=start,event=cpu,file=cpu.html

or

-agentpath:/path/to/libasyncProfiler.so=start,event=alloc,file=alloc.html

to get an allocation profile. If you copy the html files back here I would be keen to take a look at them. This will help pinpoint any unexpected issues or problems potentially exacerbated by inappropriate sizing.

thanks for the suggestion, i will try that @Richard Startin and report back (probably not soon). cool blog post on roaring bitmaps btw 🙂

ok, thanks, I look forward to it

@Peter Pringle It is also a function of things like read/write qps, expected latency, data size, and query type. If you can share those, we can help suggest a good size.