Join Slack
Powered by
The article says <1sec for approximately 1B row...
# general
k
kant
07/11/2020, 10:34 PM
The article says <1sec for approximately 1B rows. what is the average data size used?
h
Haibo Wang
07/13/2020, 4:19 AM
irrc each row is 5-10 string/int fields. With aggregate pushdown, there’s little overhead between Pinot and Presto.
k
kant
07/13/2020, 11:15 PM
Thanks. so if I am reading that article correctly which says 1B rows/sec for aggregation..so 1B * size of int = 4GB?
h
Haibo Wang
07/14/2020, 5:52 PM
yeah that's the total size for each int column. Aggregation on 1b rows in 1 sec is achievable by Pinot. You can also refer to this other Pinot benchmark:
https://www.slideshare.net/XIANGFU3/pinot-near-realtime-analytics-uber/18
Open in Slack
Previous
Next