Hello guys, we have done a upgrade from flink 13 to flink 16 now, we see a significant increase for our flink taskmanager backpressure time, is there some conf in flink 16 to do tunning so we can optimize le backpressure time ?π
here is the metric we used to observe backpressure
Have you identified which operator is causing the back pressure? You can look on the Flink dashboard
y
Yang LI
02/10/2023, 10:46 AM
We have identified the operator, it's a operator which is using event time window with 30 minutes gap configured, but it's the same operator we have used it before
d
Danny Cranmer
02/10/2023, 10:48 AM
I am not sure there is a general config to fix this for 1.16. You will need to root cause it first. If the operator is not backpressured by external system (sink), then recommend looking at the FlameGraph to see what CPU is doing