This message was deleted.

I have couple of models containzed by bentoml and deployed as docker containers. Couple of models are torch and onnx, this combined varients of continers perform poor in deployment. Just for comparsion: • mixed varients of models are 4 times slower than all torch models (i.e., with identical configuration). I could not find any reason why this could occur. Anyone have ideas to debug??