In fact, this seems like a great place for discuss...
# general
t
In fact, this seems like a great place for discussion. A technical comparison of competitive technologies (written by engineers, not product marketers or even my own DevRel people) is an incredibly useful thing, but only if it’s fair and accurate. Slack is a great place to discuss things like this.
💯 6
🔥 8
a
I have been evaluating these databases and they are all pretty amazing technologies. Join support seems to be a challenge though and something that is required for my project. This has led me to begin looking at StarRocks and Apache Doris. I am new to all of these technologies and really to analytics., so would be very interested to hear what everyone here has to say and might share about these technologies.
🤔 2
t
What do you see in Doris that you don’t in Pinot? (You’re not gonna get an argument from me. This is legit curiosity. I don’t personally know Doris well.)
a
join support. it seems that the v2 query engine might close this gap some?
I would be curious to hear about everyone's experience with these databases (Druid, Clickhouse, Starrocks, Doris, Pinot, others?) to understand what challenges they have had with them, how well they perform, how well and easily they have scaled, etc.
Challenges I have seen, some of which might be use case specific are lack of upsert support (Pinot, Starrocks, Doris do this well, but Druid, Clickhouse do not appear to). Also our solution would have a large number of tables (this is a problem for at least druid). With the large number of tables, ingestion from Kafka does not appear to scale well with at least Doris and StarRocks, hitting problem at about 1500 topics (have not been able to test the others). Then there is join support (supported well by only StarRocks, Doris, maybe Clickhouse, which I have not tested thoroughly due to apparent cumbersome upsert support)
r
Why is JOIN and UPSERT important to your use case? (I don't have a dog in this race, I am interested in the business use cases that drive the use of various database features)