Hi, We are using Trino to fetch data stored in Pin...
# troubleshooting
h
Hi, We are using Trino to fetch data stored in Pinot, via a BI tool. In the table the field
created_at
stores the epoch_timestamp in integer datatype. While querying, the BI tool generates a filter on the above field, with the syntax
from_unixtime(table1.created_at) AT TIMEZONE 'Asia/Kolkata'
this doesn't get pushdown, and Trino tries to load the entire table. any workaround for this? Also is there a looker-pinot connector in near future?
m
@Elon for Trino connector
p
We ended up integrating (well still in dev phase) with looker via looker -> trino -> pinot. Please note that trino has to be on the same k8s cluster as pinot for trino -> pinot integration to work. 1. trino -> pinot integration https://trino.io/docs/current/connector/pinot.html 2. looker -> trino just add a new connection to trino, and then you can start querying pinot data
❤️ 1
m
@Priyank Bagrecha a blog would really help the community
p
i will definitely add one once i can get a visualization working.
h
so we are able to query but since the data is not in S3 rather Pinot the push down filters are not working as expected because of the way looker generates filters on sole columns
e
There is a possibility we can get it working. Is there any way we can also contribute to looker? I contributed a long long time ago to it:)
✔️ 1