I am building a app which will host application using vllm and bentoml . I am new to bentoml. As per docs . we can server using cli but any way to run using code itself.
any cheatsheet or handbook for the same?
Thanks in advance
j
Jian Shen Yap
03/18/2025, 7:30 AM
Hello! we have the exact project for your need. https://github.com/bentoml/BentoVLLM
This is an active project and we continue to update it with new models