Hi I am working on a project using Bentoml's adapt...
# ask-for-help
m
Hi I am working on a project using Bentoml's adaptive batching. Is there a way to force an api to wait for a “min_latency_ms” when the first request arrives even when the service’s worker is available?
j
as of now we dont have this option available