Will upsert work with hybrid tables? Will a realtime record become active over an offline record having the same primary key value?

Currently, upsert support is limited to real-time tables only.

No. The plan is to support uploading segments to real-time table, and it is a work in progress