Hello Folks, Pinot, almost completely is competing...
# general
a
Hello Folks, Pinot, almost completely is competing on a space with Clickhouse yet there are no much direct comparisons between them which is very surprising for me. I am on a path to design an analytics pipeline + platform and have been on a investigation track on many big data technologies. Initially selected Clickhouse for its install simplicity, scale and performance when tested with our dataset. I am now wondering what Pinot has to offer and would really love to evaluate it as well. If anybody else has been on this journey or has some thoughts about the architectural anf feature differences between these two systems then please do share. Thanks in advance!
m
Hi @User this is a good starting point: https://docs.pinot.apache.org/
k
most users end up doing the comparison for their specific use cases and I think thats the right thing to do. I can list a few differences but highly encourage you to validate and make your decision • clickhouse is c++ and pinot java.. in today's world, it does not matter much but this does give a slight edge to clickhouse over pinot • clickhouse is simpler architecture than Pinot to get started but once you run in production, clickhouse also needs zookeeper and its actually a lot more complex than Pinot as you scale. Performance + features • clickhouse has sparse index where as Pinot has both sparse and row level indexing.. this is super important and Pinot will be faster than clickhouse for any use case that requires slicing and dicing. • Clickhouse full table scan is faster than Pinot. Pinot is highly optimized for random access patterns • Pinot has a ton of indexing techniques - inverted index, geo indexing, range indexing, json indexing and many more. This is the most powerful aspect of Pinot. The architecture if flexible to add indexes at will. • clickhouse has traditional materialized views and pinot has star-tree index concept which is smart and more effective. Clickhouse also has some partial join support but Pinot requires Presto for join and other cross table queries.
👍 1