This message was deleted.
# ask-for-help
s
This message was deleted.
p
what am i doing wrong?
s
Hiya! How are you running the example?
p
python3.10 -m flask run --host=0.0.0.0
s
Right; that example isn't made to be run with flask, you should be running
bentoml serve
instead!
p
ah right. do i then have to package it into a bento before i can serve it? or is there an example to serve it alongside the rest of my flask app?
s
Nope, you can simply serve it with
bentoml serve
without packaging if that's what you'd like. Because
bentoml
does a little bit more setup than a normal flask app, we don't have a good solution for running one without the
bentoml
CLI, though there is the
bentoml.HTTPServer
API (which uses the CLI under the hood).
p
ah ok gottit! thanks!
i want to serve multiple different models in a single web server each on their own endpoints. whats the recommended approach for that?
s
If that's all you need, you can simply define multiple runners and use them in each endpoint!
p
because right now it seems like i have to define the service in a bentofile.yml file. would i then have to create one bentofile.yml for each service i create?
s
Er, a service is a single server, you would only have to define one.
p
oh i see so its not a single runner per service then? i can add every single runner i need into the service inside the runners array and use them individually in each of the endpoint?
s
Yep!
p
ah gotcha thanks alot!