This message was deleted.

It’s currently not directly supported, however you can potentially use the ASGI interface to implement WebSocket endpoint, see https://docs.bentoml.com/en/latest/guides/server.html#bundle-asgi-app-e-g-fastapi

That's exactly what I came with after some research. We are postponing this effort in favor of running the model on the edge devices.