Hi All I am using Flink streaming Job to store data using iceberg table in S3 from kafka source Multiple small data files are generated so I need to rewrite data files into large data file, is there any way how I can schedule this on daily basis. I need all small file to be rewritten daily (for last day).

Delta lake has OPTIMIZE command to club the small files. Similarly just check if something is available w.r.t Iceberg.

Here we have spark procedures which can do same task. https://iceberg.apache.org/docs/0.13.0/spark-procedures/ I need to schedule this instead of manuall trigger, Do flink provides scheduling of job based on some cron expressions.

Not sure about this.

In the write options I think you can hint file sizes as well, probably can lower your checkpoint intervals too