Thanks for this @Tiago Pereira , I am using kubernetes but the problem I'm trying to solve is auto scaling in session mode
By default I have x pods running but if I get a new job which requires 8 parallelism but I only have 1 slot left in my cluster, I would like to autoscale it automatically
While I realize I can write the code to do this manually was just wondering if there is automated way which manages job queues and autoscaling which someone in the community might have used