Hey folks!
We were experimenting with using Middle managers on Spot. When experiencing Spot termination we're seeing the overlord is trying to change the worker tasks' status to shutdown from user, but its getting stuck in a loop as those tasks are no longer in known taskIds. My expectation was that once the MM goes down the overlord would be able to reschedule the worker tasks on newly spun up MM. Is my expectation incorrect or am I missing some kind of config. Please find overlord logs attached below.