Good Morning Everyone, I have a doubt related to s...
# pinot-perf-tuning
s
Good Morning Everyone, I have a doubt related to scaling of Apache Pinot. When the volume of data is continuously growing, we need to focus on scaling of the realtime server and not on broker.
s
In most of our use cases, we have found the server to be the limiting resource when data volume or qps increases. In rare cases, broker may be limiting, yes. If you have good monitoring setup in brokers and servers, you should be fine
j
@Subbu Subramaniam what kind of monitoring do you have in place for your Pinot cluster?
s
the basic monitoring of cpu/disk/memory utilization shuold help identify the limiting resource. Brokers are typically limited by memory. Servers could be limited by either cpu or memory (rarely storage)
👍 1