eywek
05/21/2021, 9:01 AMLIMIT
on a table with 4.5 millions of rows,
When I’m doing this query:
SELECT * FROM datasource_609bc4f74e3c000300131110 ORDER BY "timestamp" ASC LIMIT 100000,10
I’m getting a result in ~2.5s, and I can see in the query response stats totalDocs=4794306
which is fine
But when I’m doing this one (offset 1 000 000 instead of 100 000):
SELECT * FROM datasource_609bc4f74e3c000300131110 ORDER BY "timestamp" ASC LIMIT 1000000,10
I’m getting no rows (which isn’t the expected behavior) in ~10s and the totalDocs is 569840
(which isn’t the expected behavior either?)
I have an hybrid table with segmentPruning by time
Do you have any idea why I’m having this kind of issue?
Thank youJackie
05/21/2021, 6:05 PM100010
records for the first query, and 1000010
records for the second queryeywek
05/25/2021, 8:01 AMJackie
05/25/2021, 3:02 PMvmarchaud
05/25/2021, 3:32 PMJackie
05/25/2021, 5:09 PM1000010
records from each segment. If each segment has less than 1M records, then basically Pinot will scan the whole tableeywek
05/26/2021, 8:15 AM