rigoberto corujo
03/21/2024, 1:17 PM024-03-20T23:10:26+0000 [INFO] [cli] Service loaded from Bento directory: bentoml.Service(tag="pytorch_mnist_demo:fml2z4xekol6llg6", path="/home/bentoml/bento/") 2024-03-20T23:10:27+0000 [INFO] [cli] Service loaded from Bento directory: bentoml.Service(tag="pytorch_mnist_demo:fml2z4xekol6llg6", path="/home/bentoml/bento/") 2024-03-20T23:10:27+0000 [INFO] [cli] Environ for worker 0: set CPU thread count to 1 2024-03-20T23:10:27+0000 [INFO] [cli] Prometheus metrics for HTTP BentoServer from "/home/bentoml/bento" can be accessed at <http://localhost:8080/metrics>. 2024-03-20T23:10:27+0000 [INFO] [cli] Starting production HTTP BentoServer from "/home/bentoml/bento" listening on <http://0.0.0.0:8080> (Press CTRL+C to quit) 2024-03-20T23:10:53+0000 [INFO] [api_server:1] Service loaded from Bento directory: bentoml.Service(tag="pytorch_mnist_demo:fml2z4xekol6llg6", path="/home/bentoml/bento/") 2024-03-20T23:10:53+0000 [INFO] [runner:pytorch_mnist:1] Service loaded from Bento directory: bentoml.Service(tag="pytorch_mnist_demo:fml2z4xekol6llg6", path="/home/bentoml/bento/") 2024-03-20T23:10:54+0000 [ERROR] [runner:pytorch_mnist:1] An exception occurred while instantiating runner 'pytorch_mnist', see details below: 2024-03-20T23:10:54+0000 [ERROR] [runner:pytorch_mnist:1] Traceback (most recent call last): File "/home/bentoml/.virtualenv/lib/python3.12/site-packages/bentoml/_internal/runner/runner.py", line 311, in init_local self._set_handle(LocalRunnerRef) File "/home/bentoml/.virtualenv/lib/python3.12/site-packages/bentoml/_internal/runner/runner.py", line 153, in _set_handle runner_handle = handle_class(self, *args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/bentoml/.virtualenv/lib/python3.12/site-packages/bentoml/_internal/runner/runner_handle/local.py", line 27, in __init__ self._runnable = runner.runnable_class(**runner.runnable_init_params) # type: ignore ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/bentoml/.virtualenv/lib/python3.12/site-packages/bentoml/_internal/frameworks/common/pytorch.py", line 52, in __init__ functools.partial(cls.__init__, *args, **kwargs)( File "/home/bentoml/.virtualenv/lib/python3.12/site-packages/bentoml/_internal/frameworks/common/pytorch.py", line 76, in __init__ self.model: ModelType = loader(bento_model, device_id=self.device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/bentoml/.virtualenv/lib/python3.12/site-packages/bentoml/_internal/frameworks/pytorch.py", line 79, in load_model model: "torch.nn.Module" = torch.load(file, map_location=device_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/bentoml/.virtualenv/lib/python3.12/site-packages/torch/serialization.py", line 1026, in load return _load(opened_zipfile, ^^^^^^^^^^^^^^^^^^^^^ File "/home/bentoml/.virtualenv/lib/python3.12/site-packages/torch/serialization.py", line 1438, in _load result = unpickler.load() ^^^^^^^^^^^^^^^^ TypeError: code() argument 13 must be str, not int 2024-03-20T23:10:54+0000 [ERROR] [runner:pytorch_mnist:1] Traceback (most recent call last): File "/home/bentoml/.virtualenv/lib/python3.12/site-packages/starlette/routing.py", line 732, in lifespan async with self.lifespan_context(app) as maybe_state: File "/usr/local/lib/python3.12/contextlib.py", line 210, in __aenter__ return await anext(self.gen) ^^^^^^^^^^^^^^^^^^^^^