but select from transaction line limit 2147483645 it is work

Question

but select from transaction line limit 2147483645 it is working

Ken Krugler · Answer

I have to assume somewhere in the code is an `int val = lt sql query limit gt + 1` or equivalent that overflows when you pass Integer MAX VALUE as the limit But why would you want to use such a huge limit slightly smiling face

jose farfan · Answer

Hi

jose farfan · Answer

The problem is with this query in presto

jose farfan · Answer

with lastValue as select player nr rank OVER PARTITION BY player nr id ORDER BY processTime DESC AS rnk FROM pinot default transaction line select count from lastvalue where rnk=1 limit 100000

jose farfan · Answer

SQL Error 84213860 Query failed 20210213 035642 00049 23fka Error when hitting host Server 172 19 0 7 8098 with pinot query SELECT player nr processTime id FROM transaction line REALTIME LIMIT 2147483647

jose farfan · Answer

then I getting this message

jose farfan · Answer

I am trying to update this parameter pinot broker enable query limit override to a small values but it is not creating the effect that I want

jose farfan · Answer

I have used the api to update ``` allowParticipantAutoJoin true enable case insensitive false pinot broker enable query limit override 10000000 default hyperloglog log2m 8 ```

Ken Krugler · Answer

I haven t tried using the API to update broker settings sorry but changing in the config has worked for me then restart the broker processes

Kishore G · Answer

Ah if you are using with presto then use the streaming api

Kishore G · Answer

< Xiang Fu> will be able to point to the instructions to enable that

Kishore G · Answer

That will allow full scan in parallel

jose farfan · Answer

Hi < Ken Krugler> I did the change and a broker conf file with this values

jose farfan · Answer

```pinot broker enable query limit override = true pinot broker query response limit = 10000000```

jose farfan · Answer

now the query console of pinot is working with this query SELECT player nr processTime id FROM transaction line REALTIME LIMIT 2147483647

jose farfan · Answer

but when I use prestodb I get the same error

jose farfan · Answer

hi at the end I fixed I have changed the configuration of presto for pinot and add this line to pinot file the catalog folder

jose farfan · Answer

pinot forbid broker queries true

jose farfan · Answer

And now it is working

jose farfan · Answer

Thx Kishore Ken for your help

jose farfan · Answer

have a nice weekend

Kishore G · Answer

You too btw you don t want to forbid broker queries for everything

Kishore G · Answer

We will help you next week with the right config

jose farfan · Answer

thx

Xiang Fu · Answer

to enable streaming connector in presto please config ```pinot use streaming for segment queries=true```

Xiang Fu · Answer

in pinot you need to configure ```pinot server grpc enable=true pinot server grpc port=8090```

Xiang Fu · Answer

also you need to make the pinot change first then presto changes

jose farfan · Answer

hi many thxs I will try asap