hey all, is the replica group concept implemented for realtime tables too? In documentation only offline table example is given.

That query does not work but removing "TOP 10000" does. Presto adds the "TOP 10000" automatically. Side-note: I obfuscated my query to simplify it for the chat.

hello everybody

Hi @User!! I have just found Pinot 🙂

Could Pinot fix good with this kind of data? can it do such things?

and for example i shoul dneed custom aggregators, like min, max etc...can i build custom aggregators?

just to understand @User please, could you give me a link to understand how can i create custom aggregators?

@User works for me

@User maybe also because i set REFRESH as segmentPushType so i read with this setting i cannot append directly. it is just a copy of the data i want to query...without the possibility to add new data

hey all, I observed this weird behavior, with same setup the latency and server cpu usage is varying at different time: case 1 - PT done after few minutes of table creation

1000 rps -> mean latency 185ms

cpu usage by server -> 2.5 cores

case 2 - PT done after 8-10 hrs of table creation

1000 rps -> mean latency 20 ms

cpu usage by server -> 850 millicores

Any idea what may be the reason?

so basically something like String, [INT, INT] for example...talking about shema definition

could it make sense?

Are there any recommended designs for how to handle currency codes with Pinot tables that store money values?

hey all, right now i am getting only warn and error logs, how can i get the info logs?(k8s setup)

<!channel> The Apache Pinot documentation (https://docs.pinot.apache.org/) has undergone a major restructuring in an effort to make it easier for you to be able to get to the content you need to know. As a part of this effort, we've organized things around three personas: users, developers, and operators. Please reach out to me if you have any feedback, suggestions, or most importantly if you find broken links or content that lacks the quality you expect. This is essential to our efforts to make Pinot as easy as possible to get started with and to maintain in production. Thank you!

or I am missing anything

Also, are you running this from query console? I ask because query console uses sql by default I guess. With SQL, predicates within double quotes get parsed incorrectly and that unfortunately leads to an error during execution on the server

How can i query complex nested json data from Pinot, do we need to flatten before ingestion or does pinot can support json functions ?.

@User https://help.github.com/en/github/collaborating-with-issues-and-pull-requests/checking-out-pull-requests-locally

I tried again putting a breakpoint on extractFinalResult but no call

While validating using api, dateTimeFieldSpec section is getting ignored. Can someone guide me on this

<!here> Hi all. Our first virtual meetup is now starting. https://www.meetup.com/apache-pinot/events/270167242/ Here is the meeting video URL in case you cannot sign up.

@User will upsert will be available for batch data as well?

will protobuf support tie in with kafka schema registry as well?

Ah, it looks like Presto might just push views down to the connector. That seems weird if I want a view across connectors.

Hi, I want to ask question about pinot data structure. I was confused a bit. Firstly, I want to give a feedback about the Apache pinot documentations. I think, documentations can be improved. I could not find some necessary informations from docs. This could be my fault. I do not know, you can warn me. Pinot segments is created incrementally based on time. For example, for daily granularity, segments will be created for each day. This is the default and necessary feature for segments like Apache Druid segments. So, we can get best performance when use time based query. Can we define any segment configurations like maximum segment size? For example, for Sunday, we have 10gb data. I want to create 5 segments with 2gb data instead of one segment with 10gb data. Do this operation supported? Segment have metadata information. We can get all segment names of a table from controller api, then we can get metadata(segment uri etc) of each segment from controller api. • In segment metadata, what location "segment URI" represents? Deep storage or offline server location? • Can I get all segments metadata information from controller in one query? (because, i saw the api accepts only one segment to get segment metadata information) Also, I want to read segment. Apache Pinot creates segment file, then compress it to

.tar.gz

format. Can I read compressed segment file(eg: segment_1.tar.gz) with

PinotSegmentRecordReader

directly? Or do I

unTar

compressed file firstly? Shortly, can I read compressed segment file from offline server or deep storage directly? Or do I have to download compressed segment file to local first, and untar and read it? How flow can be to read segment? Thank you so much!

what is sysdate equivalent in pinot query? actually i trying to compare fields with current date / time in superset

So it's not absolutely necessary this query be interpreted as an ansi sql query then - can be a shorthand. Just might be confusing for a user who didn't intend to issue that query, i.e. they forgot to add the group by clause... like me when I was testing this 🙂

is there any benchmark on multi-value columns query performance and performance tuning guide?

Hi, I want to access broker debug api. I'm getting response 200(OK) from broker when I send request to the broker

Path("health")

endpoint. But did not any response when I want to access `Path("/debug/routingTable/{tableName}")`endpoint. It returned 500 (internal server error). Also,

Path("/debug/timeBoundary/{tableName}")

endpoint returned 404 not found(that means timeBoundary information not found for the given table). Why I can not get routing table information from broker? I'm working in local with

quick-start-batch

example. https://docs.pinot.apache.org/basics/getting-started/running-pinot-locally version: 0.3.0