Hi I d like to run `bin quick start hybrid sh` with `pinot b Apache Pinot #troubleshooting

Hi, I'd like to run `bin/quick-start-hybrid.sh` wi...

Ali

09/29/2021, 5:03 PM

Hi, I'd like to run

bin/quick-start-hybrid.sh

with

pinot.broker.enable.query.limit.override=true

pinot.broker.query.response.limit=10000

, how can I do this? I have tried

bin/quick-start-hybrid.sh -configFileName conf/pinot-broker.conf

but

-configFileName

is not accepted as a valid argument.

Xiang Fu

09/29/2021, 8:08 PM

quickstart doesn’t have those options, you need to start pinot components separately with config files

Ali

09/29/2021, 8:31 PM

Thanks

Ali

09/29/2021, 8:40 PM

The reason I wanted to set the query limit is because when using the jdbc driver, by default every query without a limit has a

limit  2147483647

appended to it. This seems to cause issues with some queries e.g.

SELECT airlineStats.Origin, SUM(airlineStats.AirTime) FROM airlineStats GROUP BY airlineStats.Origin LIMIT 100

works but

SELECT airlineStats.Origin, SUM(airlineStats.AirTime) FROM airlineStats GROUP BY airlineStats.Origin LIMIT 2147483647

doesn't.

Ali

09/29/2021, 8:42 PM

I'm connecting to pinot using tableau+jdbc and I don't see anything way of setting a limit on the driver or its config.

Ali

09/29/2021, 8:42 PM

Anyway, this seems like a bug?

Xiang Fu

09/30/2021, 12:42 AM

I think this is a bug. @Jackie does Pinot preallocating space based on the limit groups?

Jackie

09/30/2021, 12:44 AM

@Ali Which version of pinot are you running?

Jackie

09/30/2021, 12:45 AM

We fixed a bug related to large limit, but that only applies to selection query: https://github.com/apache/pinot/pull/7112

Jackie

09/30/2021, 12:47 AM

@Ali What exception did you see when running

SELECT airlineStats.Origin, SUM(airlineStats.AirTime) FROM airlineStats GROUP BY airlineStats.Origin LIMIT 2147483647

Ali

09/30/2021, 5:54 PM

Thanks @Jackie. I think this is the stack trace.

Copy code

2021/09/29 21:38:19.487 INFO [QueryScheduler] [pqr-4] Processed requestId=11,table=airlineStats_OFFLINE,segments(queried/processed/matched/consuming)=31/30/30/-1,schedulerWaitMs=1,reqDeserMs=0,totalExecMs=7,resSerMs=0,totalTimeMs=8,minConsumingFreshnessMs=-1,broker=Broker_192.168.1.161_8000,numDocsScanned=9392,scanInFilter=0,scanPostFilter=18784,sched=fcfs,threadCpuTimeNs=2829230
2021/09/29 21:38:19.490 ERROR [PinotQueryResource] [grizzly-http-server-15] Caught exception while sending query request
java.io.IOException: Failed : HTTP error code : 500
	at org.apache.pinot.controller.api.resources.PinotQueryResource.sendPostRaw(PinotQueryResource.java:305) ~[pinot-all-0.8.0-jar-with-dependencies.jar:0.8.0-c4ceff06d21fc1c1b88469a8dbae742a4b609808]
	at org.apache.pinot.controller.api.resources.PinotQueryResource.sendRequestRaw(PinotQueryResource.java:343) ~[pinot-all-0.8.0-jar-with-dependencies.jar:0.8.0-c4ceff06d21fc1c1b88469a8dbae742a4b609808]
	at org.apache.pinot.controller.api.resources.PinotQueryResource.getQueryResponse(PinotQueryResource.java:225) ~[pinot-all-0.8.0-jar-with-dependencies.jar:0.8.0-c4ceff06d21fc1c1b88469a8dbae742a4b609808]
	at org.apache.pinot.controller.api.resources.PinotQueryResource.handlePostSql(PinotQueryResource.java:137) ~[pinot-all-0.8.0-jar-with-dependencies.jar:0.8.0-c4ceff06d21fc1c1b88469a8dbae742a4b609808]
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?]
	at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:?]
	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
	at java.lang.reflect.Method.invoke(Method.java:566) ~[?:?]
.....
2021/09/29 21:38:19.491 ERROR [PinotQueryResource] [grizzly-http-server-15] Caught exception in sendQueryRaw
java.io.IOException: Failed : HTTP error code : 500
	at org.apache.pinot.controller.api.resources.PinotQueryResource.sendPostRaw(PinotQueryResource.java:305) ~[pinot-all-0.8.0-jar-with-dependencies.jar:0.8.0-c4ceff06d21fc1c1b88469a8dbae742a4b609808]
	at org.apache.pinot.controller.api.resources.PinotQueryResource.sendRequestRaw(PinotQueryResource.java:343) ~[pinot-all-0.8.0-jar-with-dependencies.jar:0.8.0-c4ceff06d21fc1c1b88469a8dbae742a4b609808]
	at org.apache.pinot.controller.api.resources.PinotQueryResource.getQueryResponse(PinotQueryResource.java:225) ~[pinot-all-0.8.0-jar-with-dependencies.jar:0.8.0-c4ceff06d21fc1c1b88469a8dbae742a4b609808]
.....
2021/09/29 21:38:19.491 ERROR [PinotQueryResource] [grizzly-http-server-15] Caught exception while processing post request
java.io.IOException: Failed : HTTP error code : 500
	at org.apache.pinot.controller.api.resources.PinotQueryResource.sendPostRaw(PinotQueryResource.java:305) ~[pinot-all-0.8.0-jar-with-dependencies.jar:0.8.0-c4ceff06d21fc1c1b88469a8dbae742a4b609808]
	at org.apache.pinot.controller.api.resources.PinotQueryResource.sendRequestRaw(PinotQueryResource.java:343) ~[pinot-all-0.8.0-jar-with-dependencies.jar:0.8.0-c4ceff06d21fc1c1b88469a8dbae742a4b609808]
	at org.apache.pinot.controller.api.resources.PinotQueryResource.getQueryResponse(PinotQueryResource.java:225) ~[pinot-all-0.8.0-jar-with-dependencies.jar:0.8.0-c4ceff06d21fc1c1b88469a8dbae742a4b609808]
....

Ali

09/30/2021, 5:55 PM

I also get similar errors when using the jdbc driver, where the limit defaults to 2147483647.

Jackie

09/30/2021, 10:26 PM

This is the stack trace on controller side. Can you please check the error log on the servers?

3 Views

Open in Slack

Previous Next