hello folks! does anyone run pinot on kube in production at scale? Is it actually compatible or will be a world of pain?

Is it possible to achieve parallelism in admin.sh create segment command?

Pinot.pdf

@User where can I find the design doc/PR for supporting mutation in pinot?

whats your apache id

we have a list of the important ones created by our SREs: https://apache-pinot.readthedocs.io/en/latest/in_production.html#monitoring-pinot

@User Hi, did you send the email to Apache Pinot mailing list? I didn't receive any emails in Apache Pinot mailing lists.

You can do it.

@User we’re you able to push the upsert branch?

hi @User just following up on this pull request (https://github.com/apache/incubator-pinot/pull/3849) Ting submitted back in Apr. Would you mind share your main concern/blocking issue over this diff? if there wasn't any major concern can we merge this diff in soon as it is bug for anyone relies on external deep storage?

Hi Folks. You can now query Pinot via Presto with full pushdown support. Find more details at https://github.com/prestodb/presto/blob/master/presto-docs/src/main/sphinx/connector/pinot.rst. This just got merged into the trunk of prestodb/presto repo. There are no plans to backport this to prestosql currently. Thanks !

Hi team Pinot! Are there any good-first issues for first-time contributors to start with? Such issues would be really helpful for new comers.

Hi everyone, I was looking at the docs for using an hdfs instance as segment store for Pinot. Though I don't fine that much in the docs on how to connect the two. Does anyone know how to do it? This could be an improvement to the documentation for beginners. Thanks.

in Pinot, how do you deal with schema evolution? Let’s say new field or metric is added to the message, is there a way to alter the table on the fly?

Even if we solve this within Pinot, it will be same unless data is partitioned by order id

yes. there is a connector for pinot and superset

@User I connected it recently. You will need to install SqlAlchemy connector (https://github.com/betodealmeida/pinot-dbapi)

@User startree index is not generated for realtime segments

@User thank you! Was looking at it earlier, but still unclear where sum is calculated :) From your perspective, how hard will it be to add dynamic aggregations (sums, counts, min, ...). Aggregation spec can be extended easily, how about actual calculations?

looking at the code, I do see that we support multiple aggregation functions. See ValueAggregator interface

@User have you check the log from the server that didn’t reply?

I am positive I am missing something here. There are no messages produced on the topic (therefore, nothing to consume for the realtime consumers), and yet, when you issue a query, the realtime servers crash. Is that correct? How many offline segments do you have?

@User no.

is it ignored or must be set?

and any reason why PERCENTILE supports floats but PERCENTILEEST works on longs/ints only ?

Hi, we want to use google cloud storage as a pluggable storage, does anyone have any example configs or advice on how to do that? cc: @User @User

Add the tagOverrideConfig, but the functionality is not in effect? https://github.com/apache/incubator-pinot/issues/4891

What api call would that be?

for now, the work around is to create another column and model it as a multi-value column and use IN

We noticed that select from <table> and <table>_offline started to diverge after a few hours. What is the cause of diverging counts?