Hello ! I am beginning to use openllm to benchmark multiple LLMs. I have x4 24GB nvidia GPUs. When executing openllm hello by default, all of the GPUs are detected but only one is used to determine (and run) what models are compatible. Looked online but didn't find a proper working way to pass multiple GPU to vllm backend. Kinda stuck here if anyone can help 🙏 Works well when using vllm backend standalone.

CC @Jiang