- we are thinking to limit to 1k, and were wondering what other pinot installations use.
j
Jackie
01/23/2021, 1:31 AM
This config is used to prevent super expensive queries exhaust the resource on the servers. Based on your use case, you may choose the value accordingly. If normally you won't run query with limit higher than 1000, you can set it to 1000, and it will bound the limit to 1000
x
Xiang Fu
01/23/2021, 11:56 PM
this is typically used to prevent external integrations like presto to overload the system for queries like
select *
Xiang Fu
01/23/2021, 11:59 PM
also it might give incorrect results for queries like big joins if the predicate cannot be pushed down. Which means your query requires full table scan.
💡 1
Xiang Fu
01/23/2021, 11:59 PM
This should be better resolved when moving to streaming api