Hello Guys,
I am trying to use Pinot with presto ...
# troubleshootinga
AHMEDSHEHATA
06/13/2022, 3:47 PMHello Guys,
I am trying to use Pinot with presto connector most of things work smooth but I have two issues accessing my tables :
When I query with agg
I get trino error: Segment query returned '50001' rows per split, maximum allowed is '50000' rows. with query ..
I tried config as pinot.segments-per-split= connector config also I tried to "realtime.segment.flush.autotune.initialRows" AS TABLE CONFIG
no hope ! the second issues I need is guidance about getting table metadata basically I use pinot in super set and the table metadata fails
m
Mayank
06/13/2022, 3:50 PM
@Xiang Fu ^^
🎯 1
a
AHMEDSHEHATA
06/13/2022, 3:55 PMThank you @Mayank <3
x
Xiang Fu
06/13/2022, 6:38 PM
You can config pinot.max-rows-per-split-for-segment-queries in Trino connector config
👍 1
a
AHMEDSHEHATA
06/14/2022, 8:03 AMThank you yes i found it n the repo code and fixed it yesterday ❤️ . How about the issue of the metadata and when I type * the query keep run forever on superset ..
One more issue there is type mismatch in case of boolean the fields are boolean pinot schema but when I query on them trino give me cant convert s varchar = boolean
AHMEDSHEHATA
06/14/2022, 8:04 AMappreciated quick response thank you @Xiang Fu
x
Xiang Fu
06/14/2022, 9:07 AM
you mean
select * from myTableXiang Fu
06/14/2022, 9:07 AM
or just
*Xiang Fu
06/14/2022, 9:07 AM
boolean support is recently added
Xiang Fu
06/14/2022, 9:08 AM
can you try python lib pinotdb version 0.3.11 for superset?
a
AHMEDSHEHATA
06/14/2022, 10:16 AM@Xiang Fu i query pinot from superset via the connector you kindly, you mean i should install pinotdb version 0.3.11 on superset machine ?
AHMEDSHEHATA
06/14/2022, 10:32 AMpresto
AHMEDSHEHATA
06/14/2022, 10:40 AM@Xiang Fu i think the issue is mainly in the boolean support is there is any way i can let boolean type supported to query via pinot connector .. I think this "*" is not the issue. the issue mainly is from having a boolean column in my pinot table and trying to query this table on superset via trino connector
AHMEDSHEHATA
06/14/2022, 11:31 AMone article show that no map for boolean to boolean https://prestodb.io/docs/current/connector/pinot.html.
The other blog show map
https://trino.io/blog/2020/05/25/pinot-connector.html
AHMEDSHEHATA
06/14/2022, 11:31 AMcan you please help me with this ?
x
Xiang Fu
06/14/2022, 5:18 PM
hmm I think trino is not yet upgraded for real boolean
Xiang Fu
06/14/2022, 5:18 PM
it’s still on string
Xiang Fu
06/14/2022, 5:21 PM
cc: @Elon any idea on boolean support
e
Elon
06/14/2022, 5:25 PMIt is fully supported in the latest version of the connector
Elon
06/14/2022, 5:26 PMHi @AHMEDSHEHATA, what version of pinot do you run?
x
Xiang Fu
06/14/2022, 5:26 PM
👍 Then the question is which version of pinot and trino are you running
➕ 1
a
AHMEDSHEHATA
06/14/2022, 7:11 PMpoc: pinot release-0.9.3
👍 1
e
Elon
06/14/2022, 7:11 PMand which version of trino?
a
AHMEDSHEHATA
06/14/2022, 7:12 PM./trino version show me
Trino CLI 351-958-g2934b5f-dirty
e
Elon
06/14/2022, 7:12 PMah, that's why - can you upgrade to the recent release?
a
AHMEDSHEHATA
06/14/2022, 7:12 PMrecent release of trino itself
AHMEDSHEHATA
06/14/2022, 7:12 PMbut no change in the connector or so ?
e
Elon
06/14/2022, 7:12 PMyep, the connector code in that version was before boolean was implemented in pinot
Elon
06/14/2022, 7:13 PMso pinot is fine but trino needs to be a more recent version
🙏 1
a
AHMEDSHEHATA
06/14/2022, 7:13 PMThanks Elon ❤️ will do so and come back to you
🙏 1
e
Elon
06/14/2022, 7:23 PMok, good luck:)
a
AHMEDSHEHATA
06/17/2022, 5:29 PM@Elon @Xiang Fu After upgrading trino version to latest things worked properly. will take snap of the stable version..
Thank you. it was all about the version
🎉 1
e
Elon
06/17/2022, 6:31 PMNice!
Elon
06/17/2022, 6:31 PMHappy friday:)