https://pinot.apache.org/ logo
#general
Title
# general
m

Matt

12/08/2020, 10:53 PM
Is there any doc detailing comparison of Pinot with ElasticSearch somewhere?
x

Xiang Fu

12/08/2020, 10:54 PM
@Yupeng Fu might have some insight
👍 1
m

Matt

12/08/2020, 10:55 PM
Could you please highlight the major differences and insights
or point me to any doc?
k

Ken Krugler

12/08/2020, 11:13 PM
Hi Matt - I should probably write up something, since we spent several months trying to get ES to work for our situation, and eventually bailing in favor of Pinot.
👍 1
y

Yupeng Fu

12/08/2020, 11:13 PM
at high-level ElasticSearch is good for search such as ranking or text search. Pinot is more efficient on storage and performant for analytical uses. At Uber, we are migrating the real-time analytical use cases from ElasticSearch to Pinot
👍 4
yeah, similarly, we have not published things yet, but will some time next year
m

Matt

12/09/2020, 12:23 AM
@Ken Krugler Thanks that would be very useful for people coming from ES world
m

Mayank

12/09/2020, 12:25 AM
@Ken Krugler that is great to know. Would be awesome if you can blog about it.
m

Matt

12/09/2020, 12:26 AM
@Yupeng Fu Pinot also have a Text Index which I tried as test and seems performing well. Still have to compare with ES though.
y

Yupeng Fu

12/09/2020, 12:45 AM
@Matt when I said text search, I meant to return the document snapshot in search context, in which ElasticSearch uses a document model whereas, Pinot builds the index on a text column for not document.
d

Darshan

12/09/2020, 1:08 AM

https://www.youtube.com/watch?v=luMLCDANxiU

@Kishore G talks about inverted index @11:01
The video helped me!
m

Matt

12/09/2020, 10:27 PM
@Yupeng Fu I am still trying with Pinot, I assume we can store a full document as a Json varchar column in Pinot. If I understand you correctly ES document model is different also I assume ES might have high cardinality.
y

Yupeng Fu

12/09/2020, 10:30 PM
yes. you can try that. fyi, there is a PR in the community to add the json indexing https://github.com/apache/incubator-pinot/pull/6216
m

Matt

12/09/2020, 10:34 PM
Thanks @Yupeng Fu
p

Playsted

12/11/2020, 2:23 AM
I would love to hear comparisons on Pinot and elasticsearch and what made you choose Pinot. Currently evaluating both for user facing interactive reporting. Mostly simple filtering with some fuzzy text matching. Pinot has a lot going for it but enterprise support for elasticsearch is a bonus as we aren't a Java group so digging into Pinot would be quite an effort vs paid ES support