Hi, If we have a hybrid table where the REALTIME p...
# general
m
Hi, If we have a hybrid table where the REALTIME part is an upsert table (OFFLINE is old data based on an old version of the schema), it seems we can query this table with 'select ... from tablename_REALTIME' and get the upserted result. Is this an ok way of working? I just want to check if this is the recommended way of doing things.
h
Both offline and real-time should really have the same schema. What happens when you query the hybrid table that returns results from both?
m
Sorry, I did not express myself clearly, REALTIME and OFFLINE have the same schema, we ingested data into the OFFLINE part from a table with older data, and that older table had a different schema. When we query the hybrid table we get the upserted data but also data from the OFFLINE part.
h
You have the option of just creating a REALTIME table.
m
How? I also want to be able to query the old data from the same table?
h
Then staying with a hybrid table is the way to go. You have the option of querying OFFLINE and REALTIME individually or you can do both by selecting the "tablename" without OFFLINE or REALTIME suffix
m
Ok, thank you! Then we can proceed 🙂
🍷 1
m
Hey @Martin Siverbäck, the upsert feature does not work with hybrid tables. Other limitations listed here: https://docs.pinot.apache.org/basics/data-import/upsert#upsert-table-limitations