<@UGRJA9TEH> What’s the difference between Minion ...
# pinot-devr
robert zych
05/01/2025, 1:57 PM@Xiang Fu What’s the difference between Minion and Minion Stateless?
robert zych
05/01/2025, 1:59 PMIIUC, Minion is a Service with a StatefulSet. Minion Stateless is a Deployment with a PVC that uses a local disk for temp persistence.
robert zych
05/01/2025, 1:59 PMrobert zych
05/01/2025, 2:02 PMWas the intent of Minion Stateless to make it easier to free up the disk space used by Minion tasks?
x
Xiang Fu
05/01/2025, 3:23 PM
so the purpose of minion stateless is for the users wanna try out minion auto-scaling.
The goal of this feature is to allow users scale minions when the task is long. And shrink the minion cluster when tasks are executed and the queue is drained.
Xiang Fu
05/01/2025, 3:24 PM
the issue of statefulset is that the scale up and down has an sequence id, so if minion_0 completed all the tasks, and idle, but you cannot really scale the minion cluster down
r
robert zych
05/01/2025, 3:57 PMIs Minion auto-scaling a StarTree Pinot feature? Or can it also be used in Apache Pinot?
robert zych
05/01/2025, 3:58 PMx
Xiang Fu
05/01/2025, 4:03 PM
yeah, it’s not open-sourced but OSS users could build it
r
robert zych
05/01/2025, 4:06 PMI see now. Thanks!