Hi, I'm trying out some V2 joins on two tables wit...
# general
m
Hi, I'm trying out some V2 joins on two tables with full upsert enabled but I cannot get the skipUpsert option to work when I query (I only get the latest entry for each primary). Is this not possible?
m
Can you share the exact query / option string? Cc @Xiang Fu @Jackie
m
It's very similar to the join example at Startree. I have a table with simulated temperature values and another with simulated humidity values. They are connected through an id (like a sensor name) and a correlationId (like a unique id, sent as a kafka header). SET useMultistageEngine=true; SET skipUpsert=true; SELECT temp.id AS id, temp.value AS temperature, hum.value as humidity, temp.ts as ts, temp."__header$correlationId" as corrId FROM temperatureMeasurement as temp LEFT JOIN humidityMeasurement as hum ON temp.id = hum.id AND temp."__header$correlationId" = hum."__header$correlationId" LIMIT 1000 I have tried setting the options with OPTION as well but it gives the same result.
j
@Xiang Fu @Rong R Do you know if we carry all query options in V2 to V1 engine?
x
let me check
For my test using
UpsertQuickStart
it works:
Copy code
SET useMultistageEngine=true;
SET skipUpsert=true;
select count(*) from upsertMeetupRsvp
JOIN upsertPartialMeetupRsvp ON upsertMeetupRsvp.group_id > upsertPartialMeetupRsvp.group_id
limit 10
@Martin Siverbäck can you try the latest docker image or pinot master branch
👍 1
m
It works after upgrade to a 0.13-version. Thank you for your help! Your support here on slack is excellent.
❤️ 2