but when i try select * from githubevents."select * from githubevents" limit 5; it works.

after go through this coomunity i saw this issue and as there mentioned, i tried with latest trino version and also 406 version..but issue remain the same.

Again i noticed that in trino logs this error as well when running this command ------- 2023-02-02T065840.548Z ERROR stage-scheduler io.trino.execution.StageStateMachine Stage 20230202_065839_00007_sybbk.1 failed io.grpc.StatusRuntimeException: UNAVAILABLE: io exception at io.grpc.Status.asRuntimeException(Status.java:535) ----- Caused by: io.grpc.netty.shaded.io.netty.channel.AbstractChannel.AnnotatedConnectException: finishConnect(..) failed: No route to host: /172.15.100.154:8090 Caused by: java.net.ConnectException: finishConnect(..) failed: No route to host ------ im stuck here and looking for an answer

I think the issue is that pinot quickstart doesn’t use default grpc port 8090 documented in https://trino.io/docs/current/connector/pinot.html#grpc-configuration-properties

you need to modify this

pinot.grpc.port

config in pinot catalog

or you can disable grpc

pinot.grpc.enabled=false

but we encourage users to use grpc for better reliability and perf

@Xiang Fu Thanks..it was a issue with port opening. It is sorted now

New feature I want to cover on pinot using trino 🙂 I hope it will be merged 😇 https://github.com/trinodb/trino/pull/16974 Using OPTION assertion in passthrought query allowing us to disable upsert if needed. Only support the OPTION notation 🙂

Hi Pinot community, We have added a offline table for already existing Realtime table in pinot, From Pinot and Presto i can get data from online and offline table but in trino ,i can get data only from real-time table. I can get aggregated count for offline data in trino but SELECT * is not working for offline data Any help would be appreciated

Hi team, When I run query in trino cost 5s, and query in pinot only 700ms. Is it normal?

SELECT day as "_31647_0" , weather_cate_id as "_31650_0" , SUM(customer_flow_stat.count_passby) as "_sum_31679_0" , SUM(customer_flow_stat.count_in) as "_sum_31681_0" , SUM(customer_flow_stat.count_impression) as "_sum_31680_0" , SUM(customer_flow_stat.race_int) as "_sum_31678_0" , SUM(customer_flow_stat.count_out) as "_sum_31682_0" , SUM(customer_flow_stat.count_in) as "_sum_31681_1" , SUM(customer_flow_stat.extra_staff_dup_count_in) as "_sum_31688_0" , SUM(customer_flow_stat.reid_dup_count_in) as "_sum_31686_0" , SUM(customer_flow_stat.extra_staff_dup_count_in) as "_sum_31688_1" , SUM(customer_flow_stat.extra_takeout_dup_count_in) as "_sum_31689_0" , SUM(customer_flow_stat.total_impression_duration) as "_sum_31685_0" , SUM(customer_flow_stat.reid_dup_count_in_customize) as "_sum_31687_0" from pinot_f17ec9ee21757958fa8c0413c1245e5f.public.customer_flow_stat group by customer_flow_stat."day" , customer_flow_stat."weather_cate_id" limit 10000;

Hi team， Is the query timeout lead to below stack info? Trino：v389

io.trino.plugin.pinot.PinotException: Query select sum("count_out") from car_flow_stat where ("company_id" = '3641447288341826048') AND ("shop_id" = '4325994452308696320') AND (("create_time" >= '1687871760000' AND "create_time" <= '1687873560000')) AND ("table_type" = '1') encountered exception org.apache.pinot.common.response.broker.QueryProcessingException@28e9f0c with query "select sum("count_out") from car_flow_stat where ("company_id" = '3641447288341826048') AND ("shop_id" = '4325994452308696320') AND (("create_time" >= '1687871760000' AND "create_time" <= '1687873560000')) AND ("table_type" = '1')"
	at io.trino.plugin.pinot.client.PinotClient.lambda$submitBrokerQueryJson$6(PinotClient.java:548)
	at io.trino.plugin.pinot.client.PinotClient.doWithRetries(PinotClient.java:616)
	at io.trino.plugin.pinot.client.PinotClient.submitBrokerQueryJson(PinotClient.java:532)
	at io.trino.plugin.pinot.client.PinotClient.createResultIterator(PinotClient.java:573)
	at io.trino.plugin.pinot.PinotBrokerPageSource.getNextPage(PinotBrokerPageSource.java:112)
	at io.trino.operator.TableScanOperator.getOutput(TableScanOperator.java:311)
	at io.trino.operator.Driver.processInternal(Driver.java:410)
	at io.trino.operator.Driver.lambda$process$10(Driver.java:313)
	at io.trino.operator.Driver.tryWithLock(Driver.java:698)
	at io.trino.operator.Driver.process(Driver.java:305)
	at io.trino.operator.Driver.processForDuration(Driver.java:276)
	at io.trino.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:740)
	at io.trino.execution.executor.PrioritizedSplitRunner.process(PrioritizedSplitRunner.java:163)
	at io.trino.execution.executor.TaskExecutor$TaskRunner.run(TaskExecutor.java:488)
	at io.trino.$gen.Trino_389____20220825_102444_2.run(Unknown Source)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
	at java.base/java.lang.Thread.run(Thread.java:829)

Hi team, I would like to inquire if any of you have any thoughts or have encountered similar issues regarding this problem. https://github.com/apache/pinot/issues/11002 Thank you very much!

Hi team, I have a question regarding our setup in the Pinot. We have set up Trino and Pinot on Kubernetes, and everything is working fine. However, we are confused about the absence of a gRPC port (8090) setting for pinot-server in the Kubernetes Service configuration. In this case, does the query still use gRPC? How can we ensure or verify that the queries are being transmitted using gRPC? Thank you

Hey folks 👋 We're trying to evaluate the Pinot <> Trino connector and I was curious to hear what overhead we see typically from using it. To give you some context, we use Pinot today in service request/response like usecases with the expectation of ~50 ms-ish query latencies (@ p99). If I were to start routing these queries via Trino (to Pinot), is there a sense of how much overhead this adds? I realize it depends on the query to a large extent too but let's say we are looking at a simple scan-only query here.

Query 20230823_035154_01545_xkpfa failed: This connector does not support creating views

Will trino-pinot support this feature?

@Xiang Fu is there a plan/issue for supporting multi-stage engine features in the trino-pinot connector? i.e. pushing down more of those capabilities to Pinot?

yes! that’s on track after the pinot 1.0.0 announcement

Current DynamicTable only support single table query, will make it support complex joins pushdown as well.

Hi! 👋 I'm looking to integrate Pinot with Trino, but it looks like 1.0.0 and 1.1.0 are not currently compatible with Trino (PR for 1.1.0). Does anyone know if these versions will be made compatible with Trino in the near future? Thanks in advance for any help - this slack workspace is an awesome resource!

FYI: we’ve just landed 1.1.0 Pinot update in Trino. 👏 @Elon

Hi Everyone. Trino 449 is out. Just checked the release notes and I see for Pinot the update is about removal of support for non-gRPC clients. Does this mean 1.1.0 is now included?

Hi all, I am trying to connect pinot 1.1.0 with trinon 449 version on my k8s cluster. The queries are failing with following error:

2024-06-06T09:28:01.476Z	INFO	dispatcher-query-7	io.trino.event.QueryMonitor	TIMELINE: Query 20240606_092801_00003_2md8z :: FAILED (GENERIC_INTERNAL_ERROR) :: elapsed 6ms :: planning 6ms :: waiting 0ms :: scheduling 0ms :: running 0ms :: finishing 0ms :: begin 2024-06-06T09:28:01.465Z :: end 2024-06-06T09:28:01.471Z
2024-06-06T09:28:02.259Z	ERROR	dispatcher-query-3	io.trino.dispatcher.LocalDispatchQueryFactory	Unhandled Error
java.lang.NoClassDefFoundError: Could not initialize class org.apache.pinot.common.function.FunctionRegistry
	at org.apache.pinot.sql.parsers.rewriter.CompileTimeFunctionsInvoker.invokeCompileTimeFunctionExpression(CompileTimeFunctionsInvoker.java:74)
	at org.apache.pinot.sql.parsers.rewriter.CompileTimeFunctionsInvoker.invokeCompileTimeFunctionExpression(CompileTimeFunctionsInvoker.java:66)
	at org.apache.pinot.sql.parsers.rewriter.CompileTimeFunctionsInvoker.invokeCompileTimeFunctionExpression(CompileTimeFunctionsInvoker.java:66)
	at org.apache.pinot.sql.parsers.rewriter.CompileTimeFunctionsInvoker.rewrite(CompileTimeFunctionsInvoker.java:50)
	at org.apache.pinot.sql.parsers.CalciteSqlParser.queryRewrite(CalciteSqlParser.java:577)
	at org.apache.pinot.sql.parsers.CalciteSqlParser.compileSqlNodeToPinotQuery(CalciteSqlParser.java:514)
	at org.apache.pinot.sql.parsers.CalciteSqlParser.compileToPinotQuery(CalciteSqlParser.java:191)
	at org.apache.pinot.sql.parsers.CalciteSqlParser.compileToPinotQuery(CalciteSqlParser.java:186)
	at org.apache.pinot.sql.parsers.CalciteSqlCompiler.compileToBrokerRequest(CalciteSqlCompiler.java:32)
	at io.trino.plugin.pinot.query.DynamicTableBuilder.buildFromPql(DynamicTableBuilder.java:78)
	at io.trino.plugin.pinot.PinotMetadata.getTableHandle(PinotMetadata.java:165)
	at io.trino.plugin.pinot.PinotMetadata.getTableHandle(PinotMetadata.java:96)
	at io.trino.tracing.TracingConnectorMetadata.getTableHandle(TracingConnectorMetadata.java:140)
	at io.trino.metadata.MetadataManager.lambda$getTableHandle$5(MetadataManager.java:286)
	at java.base/java.util.Optional.flatMap(Optional.java:289)
	at io.trino.metadata.MetadataManager.getTableHandle(MetadataManager.java:277)
	at io.trino.metadata.MetadataManager.getRedirectionAwareTableHandle(MetadataManager.java:1936)
	at io.trino.metadata.MetadataManager.getRedirectionAwareTableHandle(MetadataManager.java:1928)
	at io.trino.tracing.TracingMetadata.getRedirectionAwareTableHandle(TracingMetadata.java:1493)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.getTableHandle(StatementAnalyzer.java:5837)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitTable(StatementAnalyzer.java:2290)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitTable(StatementAnalyzer.java:520)
	at io.trino.sql.tree.Table.accept(Table.java:60)
	at io.trino.sql.tree.AstVisitor.process(AstVisitor.java:27)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.process(StatementAnalyzer.java:539)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitJoin(StatementAnalyzer.java:3274)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitJoin(StatementAnalyzer.java:520)
	at io.trino.sql.tree.Join.accept(Join.java:90)
	at io.trino.sql.tree.AstVisitor.process(AstVisitor.java:27)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.process(StatementAnalyzer.java:539)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitJoin(StatementAnalyzer.java:3274)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitJoin(StatementAnalyzer.java:520)
	at io.trino.sql.tree.Join.accept(Join.java:90)
	at io.trino.sql.tree.AstVisitor.process(AstVisitor.java:27)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.process(StatementAnalyzer.java:539)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitJoin(StatementAnalyzer.java:3274)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitJoin(StatementAnalyzer.java:520)
	at io.trino.sql.tree.Join.accept(Join.java:90)
	at io.trino.sql.tree.AstVisitor.process(AstVisitor.java:27)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.process(StatementAnalyzer.java:539)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.analyzeFrom(StatementAnalyzer.java:4886)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitQuerySpecification(StatementAnalyzer.java:3080)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitQuerySpecification(StatementAnalyzer.java:520)
	at io.trino.sql.tree.QuerySpecification.accept(QuerySpecification.java:155)
	at io.trino.sql.tree.AstVisitor.process(AstVisitor.java:27)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.process(StatementAnalyzer.java:539)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.process(StatementAnalyzer.java:547)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitQuery(StatementAnalyzer.java:1568)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitQuery(StatementAnalyzer.java:520)
	at io.trino.sql.tree.Query.accept(Query.java:118)
	at io.trino.sql.tree.AstVisitor.process(AstVisitor.java:27)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.process(StatementAnalyzer.java:539)
	at io.trino.sql.analyzer.StatementAnalyzer.analyze(StatementAnalyzer.java:499)
	at io.trino.sql.analyzer.StatementAnalyzer.analyze(StatementAnalyzer.java:493)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitTableSubquery(StatementAnalyzer.java:3070)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitTableSubquery(StatementAnalyzer.java:520)
	at io.trino.sql.tree.TableSubquery.accept(TableSubquery.java:53)
	at io.trino.sql.tree.AstVisitor.process(AstVisitor.java:27)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.process(StatementAnalyzer.java:539)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.analyzeFrom(StatementAnalyzer.java:4886)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitQuerySpecification(StatementAnalyzer.java:3080)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitQuerySpecification(StatementAnalyzer.java:520)
	at io.trino.sql.tree.QuerySpecification.accept(QuerySpecification.java:155)
	at io.trino.sql.tree.AstVisitor.process(AstVisitor.java:27)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.process(StatementAnalyzer.java:539)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.process(StatementAnalyzer.java:547)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitQuery(StatementAnalyzer.java:1568)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitQuery(StatementAnalyzer.java:520)
	at io.trino.sql.tree.Query.accept(Query.java:118)
	at io.trino.sql.tree.AstVisitor.process(AstVisitor.java:27)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.process(StatementAnalyzer.java:539)
	at io.trino.sql.analyzer.StatementAnalyzer.analyze(StatementAnalyzer.java:499)
	at io.trino.sql.analyzer.StatementAnalyzer.analyze(StatementAnalyzer.java:488)
	at io.trino.sql.analyzer.Analyzer.analyze(Analyzer.java:97)
	at io.trino.sql.analyzer.Analyzer.analyze(Analyzer.java:86)
	at io.trino.execution.SqlQueryExecution.analyze(SqlQueryExecution.java:285)
	at io.trino.execution.SqlQueryExecution.<init>(SqlQueryExecution.java:218)
	at io.trino.execution.SqlQueryExecution$SqlQueryExecutionFactory.createQueryExecution(SqlQueryExecution.java:884)
	at io.trino.dispatcher.LocalDispatchQueryFactory.lambda$createDispatchQuery$0(LocalDispatchQueryFactory.java:153)
	at io.trino.$gen.Trino_449____20240606_092426_2.call(Unknown Source)
	at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:131)
	at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:76)
	at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:82)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
	at java.base/java.lang.Thread.run(Thread.java:1570)
Caused by: java.lang.ExceptionInInitializerError: Exception java.lang.NoClassDefFoundError: org/locationtech/jts/geom/Geometry [in thread "Query-20240606_092800_00000_2md8z-218"]
	at java.base/java.lang.Class.getDeclaredMethods0(Native Method)
	at java.base/java.lang.Class.privateGetDeclaredMethods(Class.java:3601)
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2856)
	at org.reflections.util.Utils.getMemberFromDescriptor(Utils.java:88)
	at org.reflections.util.Utils.getMethodsFromDescriptors(Utils.java:101)
	at org.reflections.Reflections.getMethodsAnnotatedWith(Reflections.java:482)
	at org.apache.pinot.spi.utils.PinotReflectionUtils.getMethodsThroughReflection(PinotReflectionUtils.java:97)
	at org.apache.pinot.spi.utils.PinotReflectionUtils.getMethodsThroughReflection(PinotReflectionUtils.java:88)
	at org.apache.pinot.common.function.FunctionRegistry.<clinit>(FunctionRegistry.java:64)
	at org.apache.pinot.sql.parsers.rewriter.CompileTimeFunctionsInvoker.invokeCompileTimeFunctionExpression(CompileTimeFunctionsInvoker.java:74)
	at org.apache.pinot.sql.parsers.rewriter.CompileTimeFunctionsInvoker.invokeCompileTimeFunctionExpression(CompileTimeFunctionsInvoker.java:66)
	at org.apache.pinot.sql.parsers.rewriter.CompileTimeFunctionsInvoker.invokeCompileTimeFunctionExpression(CompileTimeFunctionsInvoker.java:66)
	at org.apache.pinot.sql.parsers.rewriter.CompileTimeFunctionsInvoker.rewrite(CompileTimeFunctionsInvoker.java:50)
	at org.apache.pinot.sql.parsers.CalciteSqlParser.queryRewrite(CalciteSqlParser.java:577)
	at org.apache.pinot.sql.parsers.CalciteSqlParser.compileSqlNodeToPinotQuery(CalciteSqlParser.java:514)
	at org.apache.pinot.sql.parsers.CalciteSqlParser.compileToPinotQuery(CalciteSqlParser.java:191)
	at org.apache.pinot.sql.parsers.CalciteSqlParser.compileToPinotQuery(CalciteSqlParser.java:186)
	at org.apache.pinot.sql.parsers.CalciteSqlCompiler.compileToBrokerRequest(CalciteSqlCompiler.java:32)
	at io.trino.plugin.pinot.query.DynamicTableBuilder.buildFromPql(DynamicTableBuilder.java:78)
	at io.trino.plugin.pinot.PinotMetadata.getTableHandle(PinotMetadata.java:165)
	at io.trino.plugin.pinot.PinotMetadata.getTableHandle(PinotMetadata.java:96)
	at io.trino.tracing.TracingConnectorMetadata.getTableHandle(TracingConnectorMetadata.java:140)
	at io.trino.metadata.MetadataManager.lambda$getTableHandle$5(MetadataManager.java:286)
	at java.base/java.util.Optional.flatMap(Optional.java:289)
	at io.trino.metadata.MetadataManager.getTableHandle(MetadataManager.java:277)
	at io.trino.metadata.MetadataManager.getRedirectionAwareTableHandle(MetadataManager.java:1936)
	at io.trino.metadata.MetadataManager.getRedirectionAwareTableHandle(MetadataManager.java:1928)
	at io.trino.tracing.TracingMetadata.getRedirectionAwareTableHandle(TracingMetadata.java:1493)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.getTableHandle(StatementAnalyzer.java:5837)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitTable(StatementAnalyzer.java:2290)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitTable(StatementAnalyzer.java:520)
	at io.trino.sql.tree.Table.accept(Table.java:60)
	at io.trino.sql.tree.AstVisitor.process(AstVisitor.java:27)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.process(StatementAnalyzer.java:539)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitJoin(StatementAnalyzer.java:3274)
	at io.trino.sql.analyzer.StatementAnalyzer$Visitor.visitJoin(StatementAnalyzer.java:520)
	at io.trino.sql.tree.Join.accept(Join.java:90)
	... 29 more

Am I missing something?

Hi, wanted to know if anyone has issues with the following idea: add an endpoint to the broker which takes a

PinotQuery

directly. The advantage is that other systems that interact with Pinot can more easily rewrite queries. wdyt? If it sounds good, I can take a stab at it, will make the connector (from any engine) easier and less errorprone to work with cc @Kishore G @Mayank @Xiang Fu

hi All! I am trying to execute a multistage query on trino using the dynamic table approach. But im unable to force pinot to use the multistage engine for the query. Please help.

select * FROM pinot.default."SELECT * from x limit 10;SET useMultistageEngine=true;";

returns the error

Only 0 out of 0 servers responded for query SET useMultistageEngine = 'true';

i tried setting it before the query too as mentioned in docs like this

select * FROM pinot.default."SET useMultistageEngine=true; SELECT * from x limit 10";

but this fails too. How should i go about running multistage query as part of the dynamic table via trino? edit: both trino and pinot are on their latest versions.

@Elon ^^

this should be taken care of in the new pr, if u want you can try it, I will push shortly and let u know.

The current way to workaround a missing pushdown is to use trino's dynamic table (

select * from pinot.default."{pinot_sql}"

) feature, correct?