Is possible to use the Adaptive batching with webs...
# ask-for-help
a
Is possible to use the Adaptive batching with websockets?
c
Yes it is possible- you just need to call a depend service that does batching, from a websocket callback function
a
Thank you for the answer! I think that would be nice to have more examples using websockets with bentoml. Just clarifying my use case for websockets, i have a custom STT model and the audio data was send as a stream so we can return interim results.
By now I'm thinking about using http endpoints because they are simpler but I'm planning on changing to websockets in the near future.