Hi guys, I am looking for a way to delete a record in a pinot table. I am aware that Pinot doesn't support this type of operation, but in our use case we have deletes once in a while so I am wondering if there is a Hack on how to delete a record without rebuilding the whole Table ?

Is this for purging for GDPR ?

ok thanks

@User I started writing a response here:

Assuming every record has a unique id, then I can think of a hack (similar to how Lucene handles deletes) where you add a

deleted

integer field, and group by the unique id, include

max(deleted)

in the result, and the client ignores any results with that value > 0. So then you can add a record with the same unique id and

deleted = 1

, and it gets ignored. Yes, it’s a horrible hack 🙂

thanks for you answer. I thought of this solution too, but I am just wondering by how much is it gonna slow my requests.so I definitely need to benchmark it before implementing it .