Good morning, team! I'm using the Flink CDC Pipeli...
# flink-cdc
w
Good morning, team! I'm using the Flink CDC Pipeline connector with MySQL as the source and Iceberg as the sink. I have a question regarding Iceberg equality delete files. Is there a recommended approach for managing them in production? I have
sink.compaction.enabled
enabled, but it doesn't seem to rewrite or eliminate these files. I also occasionally see a cryptic "Array index out of range" error that disappears when I disable compaction. Is it better to run a separate Flink job that periodically calls the Iceberg table maintenance APIs, or any other approach? Open to suggestions, thanks! Thanks in advance!