if i understood your question... but one thing tha...
# troubleshooting
t
if i understood your question... but one thing that i´m not understanding, what are your queue jobs?
r
By queue of jobs I mean In session cluster I have 8 slots available and all of them are occupied by job/s And a new job is submitted , I would like to queue it somewhere while the cluster autoscales to fullfill the parallelism requested by the job by scaling up the pods
t
Why not changing to application mode instead?
they share something between them that needs to be on session mode?
the only downsize of application mode is that you have independent job managers
r
Wanted to avoid bringing up new pods from scratch even for small batch jobs, it will delay the execution until pod comes up And yes independent job managers is also a concern Don't want to bring up pods unless the load is high enough to trigger autoscaler
t
i will try to help you in my freetime
now im curious as well how can i do that
if you have a solution first please kindly share with me