Hey guys,
Regarding presto-pinot.
Trying to run th...
# troubleshootinga
Anish Nair
02/10/2022, 8:25 AMHey guys,
Regarding presto-pinot.
Trying to run the following query:
select b.entity_name, sum(metric1) metric1from pinot_hybrid_table ajoin dim_test_table bON a.entity_id = b.entity_idWHERE a.time_column = '2022020800'group by b.entity_name;r
Richard Startin
02/10/2022, 12:48 PMhi @Anish Nair I'll make sure @Xiang Fu sees this later
r
Rong R
02/10/2022, 4:15 PMthis usually means your presto-pinot connector version doesn't match with the pinot version.
Rong R
02/10/2022, 4:16 PMcould you share which presto-pinot version you are using? and the pinot cluster version
x
Xiang Fu
02/10/2022, 6:32 PM
@Anish Nair upgrade to latest presto code should solve your problem
Xiang Fu
02/10/2022, 6:33 PM
Or you need to add this config to all pinot servers:
pinot.server.instance.currentDataTableVersion=2a
Anish Nair
02/11/2022, 5:30 AMYes, pinot.server.instance.currentDataTableVersion=2 setting this config worked.
Pinot cluster: 0.10
Persto: 0.270
Anish Nair
02/11/2022, 5:32 AMwe have observed the lookup performance of pinot is performing better than joins in presto.
for instance, a lookup query is taking 2-3seconds and same query with join in presto is taking 10-15seconds.
Have already enabled:
pinot.use-streaming-for-segment-queries=true
any other configs you can suggest ? @Xiang Fu
x
Xiang Fu
02/11/2022, 5:42 PM
Did you profile the presto queries?
Xiang Fu
02/11/2022, 5:43 PM
Joins require more data transfer from Pinot to presto then presto does the job
Xiang Fu
02/11/2022, 5:43 PM
I would say that's by design