hey, i am playing with presto/pinot and when doing...
# generalp
Phil Fleischer
04/02/2021, 5:42 PMhey, i am playing with presto/pinot and when doing simple count queries i’m hitting rowcount maximums, anyone know why the aggregation isn’t delegated to pinot?
Phil Fleischer
04/02/2021, 5:44 PMi’m not sure if there’s some kind of hint, but it seems odd that presto would pull in all the rows instead of letting the provider do the aggregation
Phil Fleischer
04/02/2021, 5:44 PMi think maybe i should ask in trino slack channel instead… ignore me for now
k
Kishore G
04/02/2021, 5:44 PM
there is no need for any hint, it should push down aggregation and filter
x
Xiang Fu
04/02/2021, 5:44 PM
which presto and pinot are you using?
k
Kishore G
04/02/2021, 5:45 PM
ok, trino has some tricks @Elon can help
p
Phil Fleischer
04/02/2021, 5:45 PMpresto/343
Phil Fleischer
04/02/2021, 5:46 PMpinot i am on “latest” pulled today, not sure the versionn
m
Mike Davis
04/02/2021, 5:46 PMthis is an open issue in Trino https://github.com/trinodb/trino/pull/6069
p
Phil Fleischer
04/02/2021, 5:46 PMwhoa, nice find!
e
Elon
04/02/2021, 5:46 PMYep, we use it in production here, along w the other pull requests:)
m
Mike Davis
04/02/2021, 5:46 PMyou can use dynamic tables as a hint:
Copy code
SELECT * FROM pinot.default."SELECT SELECT MAX(col1), COUNT(col2) FROM pinot_table GROUP BY col3, col4";👍 1
p
Phil Fleischer
04/02/2021, 5:47 PMooh, wow, that at least will give me some idea how it might work when it’s fixed 🙂
Phil Fleischer
04/02/2021, 5:48 PM@Elon do you have your own fork, image, build? is that something you might recommend?
Phil Fleischer
04/02/2021, 5:48 PMand thanks for the quick feedback folks, very helpful
e
Elon
04/02/2021, 6:01 PMIt might be safer to use the pull requests on github, let me think on that.
Elon
04/02/2021, 6:01 PMThis all should be merged soon though