Apache Flink

image.png

This message contains interactive elements.

i have seen most implementation shared in flink conference are based on iceberg + kafka, is this the only way to make it work ?

I'm curious if this is due to one of the partitions not receiving data when the parallelism is increased.

You can try setting the `withIdleness` setting to see if that allows the watermark to continue.

<https://nightlies.apache.org/flink/flink-docs-master/docs/dev/datastream/event-time/generating_watermarks/#dealing-with-idle-sources>

thanks <@U05DFL2SZEC> its due to the idleness