Dear Team As the community grows, we are getting lots of good questions in slack channels that can be helpful not just for the members asking them, but across the community. We spent a lot of time improving our docs to answer these, but there's still a long way to go. We would now like our docs to be the knowledge base where virtually every Pinot question can be answered with a link to the documentation page. And would love to get help from the community to help achieve this aspiration. If you would like to help, please join the channel #C023BNDT0N8 Thanks in advance!

In offline-table-config.json I could find only these details.

Hii everyone ! I'm Kaustabh from India

Hello, How does Pinot decide if a field in an incoming message is null to apply the defaultNullValue? Does the key of the field have to be missing? For a String field of name 

fieldX

 with default value 

"default"

,

{
  "schemaName": "HitExecutionView",
  "dimensionFieldSpecs": [
   {
      "name": "fieldX",
      "dataType": "STRING",
      "defaultNullValue": "default"
   },...,
]}

if an incoming message has the following payload:

{
    ...,
   "fieldX": null,
    ...,
}

What is the expected value in Pinot? 

null

 or 

"default"

?

Hey guys, would there be a support for something like a tile in pinot apart from segmenting. I was looking at amazon timestream and it seems this will be a useful feature to have. In general is there a comparison of pinot against timestream. https://www.allthingsdistributed.com/2021/06/amazon-timestream-time-series-is-the-new-black.html

I dont see any difference between pinot segment and tile,

we have partitioning on time as well as any other dimension

Can I do it on both? I guess my impression from the article I posted is that it allows that

yes

this was supported in pinot since a long time

say I have lots of data coming; today I have to control kafka partitions and I am limited by the number of realtime servers I have put on how fast I can process and serve the data and this is limited now

thats a completely different problem right.. max number of consumers for kafka cannot go beyond the number of partitions

violating that will result in out of order processing

what you are looking for is supported in kinesis

yeah I am trying to figure out if tile is a giving a higher abstraction or not over segment

and Pinot's Kinesis connector will probably be the right thing for your case

because kinesis increases and decreases the number of partitions based on load

and Pinot adapts accordingly

so pinot handles the assignments across realtime servers for these partitions? and splitting it into number of segments?

is there some doc for this?

or you guys are still working on this one?

yes.. this is already there

https://cwiki.apache.org/confluence/display/PINOT/Consuming+and+Indexing+rows+in+Realtime This video from @User might be a good start

cool! will look this up. Thanks.

this is another one - https://www.confluent.io/resources/kafka-summit-2020/apache-pinot-case-study-building-distributed-analytics-systems-using-apache-kafka/

To all the Pinot power players here! Wanted to make you aware of an awesome event coming up next week: https://www.meetup.com/apache-pinot/events/277817566/ @User @User

Hello 🙂 Is there an "official" / commonly used Grafana Dashboard for Pinot ? (I've found this one -> https://github.com/daniellavoie/monitoring-apache-pinot/blob/master/examples/grafana-dashboard.json - thanks @User ^^)

Welcome new Apache Pinot community members! 👋 We're so happy you're here and joining the movement of speeeeeed for user-facing analytics. 🍷 Please take a moment, if you haven't already - to introduce yourself and tell us what brought you here! 😃 @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User @User

Or any way to transfer the failed server data to next available server.i.e. server1

👋 Hi! Just wanted to share an exciting announcement The original creators of Pinot just announced their product, (StarTree.ai)! https://twitter.com/startreedata/status/1402658065862860811 We're also hosting a virtual event on June 24th to celebrate this milestone! Would love to have you! 🙂 https://www.startree.ai/launch-event-register/