Hi. I’m still working on a poc with trino / pinot. I’m able to do pretty much all I want on the Pinot side. And I’m looking on a way to do json filtering. On the pinot side I’ve found the JSON indexing pretty efficient with a JSON MATCH. But when looking to filter on TRINO side I loose all the power of the JSON Indexing. Any way to filter from Trino on JSON using the power of the JSON indexing ? 😕
k
Kishore G
03/11/2022, 4:41 PM
Trino makes it really hard to push down udf's to Pinot dynamically. Every UDF we add to Pinot, we need to change the code in pinot-trino connector to get the power of Pinot. We are working with Trino folks to change this and make it dynamic. For now, the only option is to add enhance the connector.
can you share the queries and performance numbers with pinot vs via trino
f
francoisa
03/11/2022, 4:49 PM
There is no performance comparsion as I neeed first to filter values based on a json multival. I will maybe try to give a try to presto ans see if I can achieve what I expect.
francoisa
03/14/2022, 9:51 AM
EDIT : I’ve found a way using passthrough queries ex :
"*select* * *from* pinot."default"."select count(state) from expense_report WHERE JSON_MATCH(relationships,'""$.projects.data[*].id""=''4''') ""