Apache Druid

I heard “10k rows per second per task” – but tbh it really depends what throughput you get for your own data… as well as your own source system’s usual stuff, it’s also about what the task is being asked to do – like rollup or not, datasketches or not, filtering or not, and so on.

Thanks for the info. For the 10k rows per second per task benchmark, do you know what is the row size there?

we did some benchmarks here <https://imply.io/blog/exactly-once-streaming-ingestion/> when first introducing kafka indexing

per task number varied from 15k/s to 160k/s depending on the size of the messages

10k/s/task i think would be a pretty conservative estimate for larger messages (like a few KB, &gt;50 columns)