Matthieu Vanhoutte
10/26/2022, 2:24 PMbatchable=False performance with old bentoml release was better than with new release (better latency/throughput and no failures). ONNX models didn't have changed. Please see attached the 2 locust comparisons with exact same conditions. What could explain this?Matthieu Vanhoutte
10/28/2022, 2:33 PM