Hey. What is the best way to limit data rate ? We need to buffer data at the start of the stream of some time. To limit the state growth rate we added a thread sleep. But this causes issue with checkpoint time
m
Martijn Visser
04/26/2023, 1:33 PM
There is no best way; Flink is not built for limiting data rate. Usually if a downstream operator is busy, it will report backpressure to the previous operators to slow things down