Hi All, Is there any benchmarking for Pinot offici...
# getting-started
m
Hi All, Is there any benchmarking for Pinot officially released. i have some questions someone can answer it. 1. i've some issue on ingestion rate, as ive get around 3500 records/sec on my single segment from kafka stream. As ideally increasing servers in pinot cluster. Ingestion rate should be increased but getting same ingestion on all servers. 2. can we fix number of Segments count on specific pinot server. Ex: not more then 15 segment in any server for specific table.
k
there is one consumer created per kafka partition.. if you want faster ingestion rate.. create more partition
if all you want is balanced segment assignment, then use the feature to move completed segments to other server
m
can we fix number of segments in a table?
k
I don’t see how that will solve your problem.. what happens when the number of segments go beyond that fixed number
x
1. Use more Kafka partitions. Same mechanism as how you scale more traffic in single topic 2. Why you want this?