Hi @User, a question about real-time table’s upsert feature: would it be possible to use other columns (e.g. an int column or Kafka offset) than the event-time column (configured by

timeColumnName

in

segmentsConfig

table config) to decide which is the last version when the primary key is the same? I’m asking because Kafka Streams JOIN produces many records with the same event-time column value (in our case, the

last_update

column). So in Pinot, the last version is randomly chosen amongst these records with the same event-time. Thanks

yes, there’s an issue on this https://github.com/apache/incubator-pinot/issues/6523

Thank you. I’ll add my use case to the issue and upvote it. Is there any workaround to this at the moment?

if the issue happens on the tie of the event time, you can also use the processing time

Good point. We’ll see if it’s a legit workaround for us. Thanks 👍

sure thing 🙂