Hey all, total newbie here trying to successfully ...
# ask-for-help
m
Hey all, total newbie here trying to successfully get a local API response to an openllm model on my Macbook air M1. I’m able to go to localhost:3000 and see the API description page, after following instructions at https://github.com/bentoml/OpenLLM. But when I navigate to the /v1/generate section on that page and “Try it out” and then “Execute”, I get a 500 error which says to go look at the server logs, and the server shows a giant python stack trace. Tried this with different models on different machines, using native python install on linux/macos but also conda on linux, and consistently seeing the same issue. Am I doing something obviously wrong? Thanks in advance for any help!