Hi all, is there a way to specify retention for old updates when using upsert tables? My understanding from the docs is that upserts are still append only just that querying shows the newest one. I want to config it such that all updates are deleted after 180 days except the newest one even if it's older than 180 days, thus if no new upserts come in within 180 days only the last upsert will exist. Use case is as a serving layer as described in the enterprise application development section of the docs. Thanks

What's the retention of your data? Can this be achieved by explicit time filter in the query?

Yeah it could, just that we don't want to keep old upserts around when we don't need them

So is your data retention time > 180 (upsert retention time that you'd like)?

+1 on this. We have a similar use case. @User that’s why i asked you if materialized view is supported the other day.

I see, in that case, lets create a github issue? Or if one already exists, lets add your requirements there @User, and bump it up?

I think this is about compaction that I had a discussion with @User

We should put compaction in the roadmap, if it is not already there?

Yeah for the last upsert, we want it there even after the retention period has elapsed, but for old ones we want them gone after 180 days. Yeah sure would love for the requirements to be in there