I am building a app which will host application us...
# ask-for-help
r
I am building a app which will host application using vllm and bentoml . I am new to bentoml. As per docs . we can server using cli but any way to run using code itself. any cheatsheet or handbook for the same? Thanks in advance
j
Hello! we have the exact project for your need. https://github.com/bentoml/BentoVLLM This is an active project and we continue to update it with new models