James Fellows Yates
04/08/2025, 7:55 AMAdam Talbot
04/08/2025, 8:46 AMprocess.accelerator ?Adam Talbot
04/08/2025, 8:47 AMprocess.queue for other HPCs, or process.machineType for GCP or Azure...OK maybe we need a labelJames Fellows Yates
04/08/2025, 8:47 AMJames Fellows Yates
04/08/2025, 8:47 AMJames Fellows Yates
04/08/2025, 8:47 AM// Default executor
executor = 'lsf'
// Dynamic queue selection based on job requirements
queue = {
if (task.time > 144.h) {
return 'long'
} else if (task.label && task.label.toString().contains('process_low_gpu')) {
return 'gpuexpress'
} else if (task.label && task.label.toString().contains('gpu')) {
return 'gpu'
} else if (task.time <= 12.h && task.cpus <= 8) {
return 'express'
} else {
return 'premium'
}
}Adam Talbot
04/08/2025, 8:48 AMwithQueue
Is that a thing?!James Fellows Yates
04/08/2025, 8:49 AMAdam Talbot
04/08/2025, 8:49 AMlabel 'gpu' , which can then be combined with label process_low etcAdam Talbot
04/08/2025, 8:49 AMprocess_low_gpu,James Fellows Yates
04/08/2025, 8:49 AMJames Fellows Yates
04/08/2025, 8:50 AMAdam Talbot
04/08/2025, 8:51 AMqueue = {
if (task.label && task.label.contains("process_low") && task.label.contains("gpu")) {
return 'gpuexpress'
} else if (task.label && task.label.contains("gpu")) {
return 'gpu'
} else {
return 'non_gpu'
}
}Adam Talbot
04/08/2025, 8:52 AMJames Fellows Yates
04/08/2025, 8:53 AMJames Fellows Yates
04/08/2025, 8:53 AMAdam Talbot
04/08/2025, 8:53 AMprocess.accelerator takes integers no?it behaves differently on different executors
Adam Talbot
04/08/2025, 8:54 AMJames Fellows Yates
04/08/2025, 8:54 AMJames Fellows Yates
04/08/2025, 8:54 AMAdam Talbot
04/08/2025, 8:54 AMJames Fellows Yates
04/08/2025, 8:54 AMAdam Talbot
04/08/2025, 8:54 AMJames Fellows Yates
04/08/2025, 8:55 AMJames Fellows Yates
04/08/2025, 8:56 AMAdam Talbot
04/08/2025, 8:56 AMqueue = {
if (task.label && task.label.contains("process_low") && task.label.contains("gpu")) {
return 'gpuexpress'
} else if (task.label && task.label.contains("gpu")) {
return 'gpu'
} else {
return 'non_gpu'
}
}Adam Talbot
04/08/2025, 8:58 AMprocess {
accelerator = {
if (task.label && task.label.contains("process_low") && task.label.contains("process_gpu")) {
return 1
} else if (task.label && task.label.contains("gpu")) {
return 4
} else {
return null
}
}Adam Talbot
04/08/2025, 9:00 AMprocess {
machineType = {
if (task.label && task.label.contains("gpu")) {
return "Standard_NC*_v3"
} else {
return "Standard_E*d_v5"
}
}Adam Talbot
04/08/2025, 9:01 AMprocess_low_gpu and `process_high_gpu`:
process {
withName: process_low_gpu {
accelerator = 1
}
withName: process_high_gpu {
accelerator = 4
}
}