Hi folks! I interested in Pinot for our real-time process mining product. We ingest clickstream-like events from applications and analyze them to produce process visualizations. The one challenge I see with Pinot is that our events do not have a fixed schema which, of course, means that our database solution must support schema evolution. We always accrete new columns, never remove them. I read through https://github.com/apache/pinot/issues/4225 and I can't make out the current state of the issue. What is the proper way to gracefully evolve a Pinot schema evolution in realtime tables?

Hi everyone, We are in the process of choosing a database for our data analytics purpose. The three main contenders we have boiled down to are Apache Druid, ScyllaDB and Apache Pinot. I would love to chat with anyone who have a fair understanding of all these 3 systems. Thanks

Hello guys, is there any length limit to the string data type. My data is getting truncated. Is there some table config I am supposed to be using? Thanks

A quick question about upsert table: if the data old than the retention is ingested, will Pinot ignore it?

Hi team, I have question about Pinot retention, is the retentionTimeValue changeable without recreating offline table? And what could be the reason segment with data older than retention period doesn't get deleted?

👋 Help us welcome all the new Apache Pinot community members! 🍷 Welcome all! Would love to know who you are and what brought you here! @User @User @User @User @User @User @User @User @User

Hi folks! Hey, what's the correct date format? Is it:

fromDateTime('2022-02-01', 'YYYY-MM-DD')

or

fromDateTime('2022-02-01', 'yyyy-MM-dd')

? And where can I get a comprehensive list of what each format token means?

Hey there 👋 Quick question: does the

latest

docker image tag reflects master? Or should I use

0.10.0-SNAPSHOT-6844cb32e2-20220209-jdk11

to try out the latest master version?

Can anyone please help

Hi ! does pinot ingest batched data from postgresql too...?

I'm seeing this exception with thirdeye integration with Pinot...Can someone please help

Hi a new comer here. Does anyone have successfully run Pinot with rabbitMQ ingestion (outside AWS Kinesis capabilty) ?

Is there a reason why the docker image uses an uberjar? Most SCA tools can't work with them, and replacing a dependency jar with patched one is much more tedious (i.e. rolling out log4j2 updates quickly).

Hello great people! Gev here from Ucraft (www.ucraft.com). We are looking to start using Apache Pinot, and need some guidance and help. Does anybody know a good team that can help us? Please PM? Sorry if this is not the right place to post this kind of request.

does anyone know how to change the default values of dimension field spec values in pinot?

👋 Hi everyone! I got this error on executing

./quick-start-streaming.sh

with the same cloned pinot repo, which I usually used to run pinot on local. #C011C9JHN7R

How much time the build will generally take?

If I'm using pinot quick start what will be the zookeeper url, that I can use in thirdeye data source configuration...

Hello! Can somebody share some performance characteristics for realtime tables? How fast can server ingest from kafka, how to scale via partitions etc? Thanks

Hi folks! Just a question: when a server instance has a consuming segment, where is the data for that segment stored? Is it in memory? Or local disk? Or something else?

Anything wrong with pinot repo, I have been trying yesterday to run the quick start it just failing like this...

Hello, greetings from Rio de Janeiro, Brazil... I'm looking around for any analytics stack that could add more value than what is currently being used by my company. I can't disclose details however count on me for any help, I hope to learn a lot here and to contribute with my findings about Apache Pinot. Thank you.

Hello, has someone success with Minio S3 as a deep storage backend?

Hi Everybody, Do we have a Grafana Data source for Pinot? I want to create a dashboard for the Pinot data quickly.

Hi all, is it possible to delete data on per-record basis in Pinot? My team is exploring ways to store PII in Pinot and data deletion is part of GDPR compliance. Would love to know if anyone is using Pinot as PII store

Similar to the question above, is it possible to explicitly update rows in already committed arguments? Not that I need this now, so please don't take this question with much importance, I'm just thinking about some possible future usages for Pinot in my company

Hi @User @User @User @User can anyone of you please help me on the above error

Hey team, is there a method that will return a SQL statement as a String from a org.apache.pinot.common.request.BrokerRequest object?

Hi Team, Does anyone know any bash or python script to create schema and table in pinot ?

Is there a documentation on how to setup metrics in thirdeye...and see visualization under root cause analysis tab