This message was deleted.
# ask-for-helps
Slackbot
06/27/2023, 12:43 PMThis message was deleted.
a
Ashish Singh
06/27/2023, 1:02 PMHey @prince kumar 👋 could you also post the trace log that is showing that adaptive batching is not working?
Ashish Singh
06/27/2023, 1:06 PMI think you have read through this but maybe this could give more insight into custom batching - https://docs.bentoml.com/en/latest/guides/batching.html#custom-batching
p
prince kumar
06/28/2023, 6:24 AMI tried apache ab testing to check whether batching is happening or not. I sent 100 requests one by one and after that I sent 100 requests in the batch of 5. Time for completion for both was same