Hey all.
Does anyone have any recommendation on how one can get the autoscaler / job manager to consolidate task managers when scaling down?
E.g. this job just scaled down a large amount after overcoming a great volume of data, but there are so many taskmanagers that are half empty now - the number of task managers could probably be consolidated to 3 or 4 which - trivially - would save a lot of compute costs.
Is there any setting to help with this?