Even for the past data right?

with partial upsert you can control this behavior @User @User can provide more update on when the feature will be available

you can check out this PR https://github.com/apache/incubator-pinot/pull/6899

we'll add a doc before the release. cc @User

Thank U!

Just a reminder about tomorrows meetup! 🙂 https://www.meetup.com/apache-pinot/events/277818929/

Theta sketches talk happening now -

I'm playing with the GitHub events recipe and I wanted to do some filtering of the events based on the timestamp column. I thought the below should give me all the events that happened more than 60 seconds ago:

select count(*)
from pullRequestMergedEvents 
where createdTimeMillis < (now() - 1000*60)
limit 10

But it doesn't seem to be happy about how I tried to compute the timestamp:

[
  {
    "errorCode": 200,
    "message": "QueryExecutionError:\norg.apache.pinot.core.query.exception.BadQueryRequestException: Cannot convert value: '1.626248713067E12' to type: LONG\n\tat org.apache.pinot.core.query.pruner.ColumnValueSegmentPruner.convertValue(ColumnValueSegmentPruner.java:261)\n\tat org.apache.pinot.core.query.pruner.ColumnValueSegmentPruner.pruneRangePredicate(ColumnValueSegmentPruner.java:191)\n\tat org.apache.pinot.core.query.pruner.ColumnValueSegmentPruner.pruneSegment(ColumnValueSegmentPruner.java:105)\n\tat org.apache.pinot.core.query.pruner.ColumnValueSegmentPruner.prune(ColumnValueSegmentPruner.java:76)\n\tat org.apache.pinot.core.query.pruner.SegmentPruner.prune(SegmentPruner.java:45)\n\tat org.apache.pinot.core.query.pruner.SegmentPrunerService.prune(SegmentPrunerService.java:63)\n\tat org.apache.pinot.core.query.executor.ServerQueryExecutorV1Impl.processQuery(ServerQueryExecutorV1Impl.java:271)\n\tat org.apache.pinot.core.query.executor.ServerQueryExecutorV1Impl.processQuery(ServerQueryExecutorV1Impl.java:215)\n\tat org.apache.pinot.core.query.executor.QueryExecutor.processQuery(QueryExecutor.java:60)\n\tat org.apache.pinot.core.query.scheduler.QueryScheduler.processQueryAndSerialize(QueryScheduler.java:157)\n\tat org.apache.pinot.core.query.scheduler.QueryScheduler.lambda$createQueryFutureTask$0(QueryScheduler.java:141)\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:266)\n\tat java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)\n\tat shaded.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:111)"
  }
]

If I had it say:

where createdTimeMillis < now()

Then I get a result and no error...

hmm an issue with the type conversion, now() - 1000*60 is converted to a double value

Hi need help

Reminder about the awesome meetup happening today! 🙂 https://www.meetup.com/apache-pinot/events/279202435/

Hello everyone 🙂 I was wondering if Pinot has any plans to move long-term data to S3 (etc.) natively?

Hi all! Reminder for the meetup today with @User! We're kicking off in 40 mins. Hope to see you there! https://www.meetup.com/apache-pinot/events/277819599/

hey all, I'll give a talk at the Pinot meetup tomorrow on geospatial support, and highlight a use case of 

orders-near-you

  running in Uber Eats app. If you are interested, you can sign up at https://www.meetup.com/apache-pinot/events/277818952/?rv=md1&_xtd=gatlbWFpbF9jbGlja9[…]WYtNDY3ZS04NmJhLWU1NTBjMTY5ZWZjZg&_af=event&_af_eid=277818952

Don't miss today's meetup! https://www.meetup.com/apache-pinot/events/277818952/ With presenter @User

Please help us welcome to our newest Pinot community members!!! 🍷 👋 We'd love to know - Where are you from? What do you do? What brought you here? @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User

hey @User, thanks a lot for authoring this blog post. I thoroughly enjoyed reading it and the kitchen analogy. Some of us who know Apache Pinot in and out might think we are excellent chefs 🍷🍷🍷

image.png

Hello everyone , i have created one blog to manage offline flows :- https://medium.com/@deepakcse2k5/manage-offline-flow-in-apache-pinot-86d9fe112acc

Hello! 👋

Meetup reminder today! https://www.meetup.com/apache-pinot/events/277819011/

👋 Hello and welcome to all the new Pinot 🍷 community members! Please tell us who you are and what brought you here! 🙂 @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User

Thanks:) you can find the recording at https://www.kafka-summit.org/sessions/real-time-analytics-with-upsert-using-apache-kafka-and-apache-pinot after sign in

Fantastic news, congratulations ! 🎉

Congratulations team! 😃🎉

Reminder for our meetup today with @User on Apache Pinot & Superset: Forecasting and Visualization! See you soon! https://www.meetup.com/apache-pinot/events/277819593/

hope to see everyone in a few minutes 🙂 📈 pinot

👋 Welcome to all the new Pinot community members! 😃 🍷 Would love to know who you are and what brought you here! 🤩 @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User