everything else yes

@User to clarify, real-time tables do create star-tree index when the segments get flushed

got it, ty!

BTW, if I remove the leading spaces from the String, then it will convert successfully to int. I tried using a data transformation to do this, but they aren't allow to transform a column to the same column.

🥳 Congrats to the new #ApachePinot committers!!! 🎉 @User & @User Thank you for all of your contributions and continuous effort to give back to the community!🍷 clap1 The community thanks you! clap1

🎉 Hooray! 🎉 We've surpassed 1,000 members on the Pinot Slack 🍷 S This is a great milestone and we expect much more growth in the future! 📈 🙏 Thank you to all our PMC's, committers, contributors, and community members! 🙏 You are all vital in helping move the needle and industry-standards in fast analytics! 📊 📉 Art credit: Apache Pinot PMC & Committer @User

In case you missed it 🍷 We hosted a meetup last week with@User, software engineer in Uber’s Data team and Pinot contributor, where he reviews Uber's data ecosystem and their use of Apache Pinot. Recording is now officially live! 🎉

👋 Welcome to the newest 🍷 Apache Pinot community members!! 🧑‍🤝‍🧑 Would love to know how you found the Pinot community and what you're working on! Please introduce yourself if you haven't already! 😄 @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User

Hi everyone! I'm Michael (he/him). Thanks so much for the warm welcome!😄 Excited to learn more

what's the method for stopping a Pinot server? "StopServer" isn't a valid sub-command, do I just kill the process?

yes, there is a shutdown hook that gets triggered

🤔 Interested in learning more about the TrinoDB (formally, PrestoSQL) and the Apache Pinot 🍷 connector? 📽️ Join @User, @User next week for a live broadcast with the TrinoDB team! https://trino.io/broadcast/

Some of you might be waiting for updates the next release, we created a channel #C01QQTV06MB for further updates. Please join the channel if you want to hear more. You can also always stay up to date by subscribing to dev-subscribe@pinot.apache.org

Hi Guys,

@User -- I am also doing same you are advanced. I am planning to do this flow. MySQL --> Python Stats(code already exist) --> Json --> Avro Convertion --> Kafka Producer --> Pinot Kafka Connector --> Pinot Session Store --> SuperSet I completed till Kafka Avro Poducer and consumer. And I am doing with everything using Python language. I have few doubts: 1. my flow is feasible. Is there any changes should needed. 2. Any idea Pinot Avro ingrest. It will help me. 3. In my case json contains lot of nested entities. Then Pinot Avro help to me or I should fatten the json data to record data. Need help 🙂

@All - I am getting an error while stating zookeeper with pinot admin. zookeeper state changed (SyncConnected) Waiting for keeper state SyncConnected Terminate ZkClient event thread. Session: 0x10003506d770000 closed Start zookeeper at localhost:2181 in thread main EventThread shut down for session: 0x10003506d770000 Expiring session 0x10002b33f080005, timeout of 30000ms exceeded Expiring session 0x10002b33f080006, timeout of 30000ms exceeded Expiring session 0x10002b33f080007, timeout of 30000ms exceeded Expiring session 0x10002b33f080004, timeout of 30000ms exceeded Expiring session 0x10002b33f080008, timeout of 30000ms exceeded Expiring session 0x10002b33f080002, timeout of 30000ms exceeded Expiring session 0x10002b33f08000b, timeout of 60000ms exceeded any solutions, Need help

One doubt, How can I know which version of Kafka using by my local Pinot?

Pinot meetup talk happening now if interested (https://www.meetup.com/Big-Data-Israel/events/275800701/)- https://us02web.zoom.us/j/87876256308?pwd=dFQya3pMcnZuNGlvYUZRQzhKbmxSZz09

👋 Pinot community! I work with the Presto community, wanted to share PrestoCon Day is next week, feat. some great Pinot talks - @User is doing a session on Realtime Analytics with Presto & Apache Pinot and @User is on The Presto Ecosystem Panel. Super excited for the event - it's virtual & reg is free - hope to see many of you 🍷 there 😁👍 https://events.linuxfoundation.org/prestocon-day/register/

hello, I see that

0.7.0

was released, congrats! But there does not appear to be a corresponding

0.7.0-jdk11

image available via docker hub, only SNAPSHOT versions. Any chance that can get published?

Interesting, https://pinot.apache.org/download/ also doesn’t show

0.7.0

. Also thinking the 0.1.0 through 0.5.0 downloads could be removed from that page…

It’s not yet officially released.. there was a mix up in ASF process.. please stay tuned. We will update soon

Hi @User - Currently production user of Apache Kafka and researching ways to provide analytical report as part of our architecture. A pub sub model which is designed to scale on demand (message lag)

Hi I am Lijeesh. We are evaluating Pinot for a real-time analytical store use cases.

Hey @User 👋 , I'm Brian, a dev advocate in the Trino (formerly PrestoSQL) community 🐇 . I hopped over here initially to tell folks about the latest Trino Community Broadcast episode where we invited @User and @User to speak about Pinot and the Pinot Connector and for me I really wanted to convey, what use cases each system really solves and why 🐇 ➕ 🍷 is such a great combination. I look forward to getting to know everyone here. Feel free to reach out about any info about Trino. Commander Bun Bun says Cheers!

Hi I am Yogesh. Sr GIS Applications Developer from Richmond Virginia.. I came access pinot while listening to a talk on apache presto... I am interested in bigdata application for spatial domain

🎉 Today! Catch @User and @User’s presentations & panel talks at PrestoCon! (conference is FREE!) https://events.linuxfoundation.org/prestocon-day/

I want to overwrite all data in my offline table, and i set

segmentPushType to REFRESH.

But when i try to overwrite data with new data, old data still be stored. This is my job executon spec;

executionFrameworkSpec:
  name: 'standalone'
  segmentGenerationJobRunnerClassName: 'org.apache.pinot.plugin.ingestion.batch.standalone.SegmentGenerationJobRunner'
  segmentTarPushJobRunnerClassName: 'org.apache.pinot.plugin.ingestion.batch.standalone.SegmentTarPushJobRunner'
  segmentUriPushJobRunnerClassName: 'org.apache.pinot.plugin.ingestion.batch.standalone.SegmentUriPushJobRunner'
jobType: SegmentCreationAndTarPush
inputDirURI: 'input/'
includeFileNamePattern: 'glob:**/*.json'
outputDirURI: 'output'
overwriteOutput: true
pinotFSSpecs:
  - scheme: file
    className: org.apache.pinot.spi.filesystem.LocalPinotFS
recordReaderSpec:
  dataFormat: 'json'
  className: 'org.apache.pinot.plugin.inputformat.json.JSONRecordReader'
tableSpec:
  tableName: 'orders'
  schemaURI: '<http://localhost:9000/tables/tbl/schema>'
  tableConfigURI: '<http://localhost:9000/tables/tbl>'
pinotClusterSpecs:
  - controllerURI: '<http://localhost:9000>'

When i run this spec, it don't remove the output directory. It append segments to existing segments. But i set overwriteOutput to true. Also, should i set segmentNameGeneratorSpec to overwrite all data in my offline table?

Overwrite works by replacing segments of same names