curious, does pinot inherently handle duplicate rows based on some column? • Not as of now.

@Pradeep In many cases, de-duplication can be done at query time by using DISTINCT. Let me know if this is not an option for you. Maybe we can find a solution.

yeah I was aware of that, was just curious if we were to do upload of data from from multiple places and was wondering if there is a way to handle overlaps. not very important at the moment, something that just came to my mind, so thought would ask, thanks.

This is part of the upsert solution

nice

@Pradeep Thanks for asking. I really appreciate you putting together these questions. 👍