Let me clarify - Upsert functionality is limited to realtime-only tables. If you did have an offline table as well (in case of managed offline flow), then upsert functionality won't work across realtime and offline.
But if users were OK with this limitation, as in limit upsert to the realtime part, then they can use it in that mode (there are cases doing so).