Hi folks, is there any updates to this issue on Github https://github.com/StarRocks/starrocks/issues/69205. Our team is experiencing similar issue and this prevents us from using StarRocks in production.

To add some context here. • We are on StarRocks version

4.0.7

• We have base tables in Iceberg (with Polaris) that have billions of events per day • We have materialized views that read from the base tables. These materialized views are partitioned hourly • We have a

partition_ttl

set to

"90 days"

What happens: • The

partition_ttl

seems to be ignored by StarRocks. The initial run is running on the full 2 years of data instead of only 90 days • In subsequent runs, it also runs on the full 2 years of data instead of only the hours that changed

look at this wip https://github.com/StarRocks/starrocks/commit/ed1445a7b897045d2d49a4af5eaa5ed16543087e

I see that those commit are from December. Do we know if/when they will be merged in? It seems like there's quite a few pieces around improving materialized views with iceberg on the roadmap for StarRocks this year

i have not yet submitted them

@Jacob Scherffenberg-Møller 👀