Join Slack
Powered by
Hi I am working on a project using Bentoml's adapt...
# ask-for-help
m
Minh Huy Vũ Nguyễn
04/10/2025, 3:30 AM
Hi I am working on a project using Bentoml's adaptive batching. Is there a way to force an api to wait for a “min_latency_ms” when the first request arrives even when the service’s worker is available?
j
Jian Shen Yap
04/11/2025, 7:40 AM
as of now we dont have this option available
Open in Slack
Previous
Next