Hi, Any thoughts on this OLAP benchmark. Not sure ...
# general
r
Hi, Any thoughts on this OLAP benchmark. Not sure how reliable/verified this benchmark is. https://benchmark.clickhouse.com/ Pinot is in the middle of the pack
f
Definitly not meaning anything 😄 -> https://github.com/ClickHouse/ClickBench/issues/37 Each system provide great perfs and need to be tuned and adapted to you needs. No indexes on pinot only offline table in the test
t
Also, something to note here is this benchmark page is ran by the company Clickhouse. Not an independent third party.
r
Lies, Damned Lies and Benchmarks. Always best to run your own against your own data. Optimal cluster configuration is always going to be the achilles heel on any DB benchmark; use a DBaaS if you can, even if you aren't going to go into prod on it.
v
Looking at the open issue, it seems they are open to PRs. Perhaps an experienced Pinot user could submit the indices and we can see how it ranks?
s
There was a hacker news discussion thread about this, with lots of skeptical comments: https://news.ycombinator.com/item?id=32084571 But also, the Clickhouse docs intro advertises this benchmark under the “Why is ClickHouse so fast?” section, a lot of people probably get exposed to it.
👍 1