Does pinot have a default limit?
```select id from...
# troubleshootingy
Yash Agarwal
08/27/2021, 6:48 AMDoes pinot have a default limit?
Copy code
select id from table group by id limit 100000000m
Mayank
08/27/2021, 1:29 PM
Hmm shouldn’t be, I’ll check. Btw what are you trying to do with this query
y
Yash Agarwal
08/27/2021, 6:31 PMNot much. Just something we found during some testing. We are querying upto 1M records so we are fine right now.
Yash Agarwal
08/27/2021, 6:31 PMWe wanna have a way in future to increase it if we really want to
m
Mayank
08/27/2021, 6:45 PM
Ok, however note that this is not the best use of Pinot. Could you elaborate on what app needs to fetch 1M rows?
y
Yash Agarwal
08/28/2021, 5:59 AMWe have a presto like layer which in some cases will pull out a bunch of information to join with other datasets present in other databases.
m
Mayank
08/28/2021, 4:12 PM
Then try out the streaming api from server that presto connector also uses
y
Yash Agarwal
08/28/2021, 4:22 PMSure. But is this a hard limit ? Can this not be overriden as a parameter for our use case ?
Yash Agarwal
08/28/2021, 4:22 PMJust making sure we know the upgrade path in future.
m
Mayank
08/28/2021, 10:10 PM
@Jackie do we hard limit the select query response rows?
Mayank
08/28/2021, 10:33 PM
@Yash Agarwal I still recommend using streaming api from your connector for this usecase
j
Jackie
08/29/2021, 2:42 AMThere is no hard limit. How many distinct ids do you have?
y
Yash Agarwal
08/29/2021, 3:11 AMBillions
Yash Agarwal
08/29/2021, 1:02 PMBut why am i then only getting 1.1 million rows ?
Yash Agarwal
08/29/2021, 1:02 PMAre you also seeing the same ? Can you test it on your side