Hi everyone. I am attempting to test the
new 1.19.3 release to take advantage of this enhancement:
• [
FLINK-33977] - Adaptive scheduler may not minimize the number of TMs during downscaling
However, I'm not seeing a change in behavior. After a scale down event, the number of tasks decreases, but I'm not seeing task managers getting released like they should be. The number of Available Task Slots that is much greater than taskmanager.numberOfTaskSlots. With Flink 1.19.3, I would have expected the slot assigner to assign the remaining tasks to slots on the task managers with the highest utilization, so that the under utilized task managers could be released. This should cause the number of Available Task Slots to drop below the value of numberOfTaskSlots. I'm not seeing the Task Managers being released. Is there something that I'm missing?
• jobmanager.scheduler = adaptive
• jobmanager.adaptive-scheduler.prefer-minimal-taskmanagers = true
• taskmanager.numberOfTaskSlots = 4
• Task Managers = 54
• Total Task Slots = 216
• Available Task Slots = 55