This message was deleted.
# ask-for-help
s
This message was deleted.
c
What’s the error message that you see?
Does it fail building the image or during deployment? Could you also share more about your code, model, deployment config and cluster setting?
The best way to debug is by looking through the logs from related pods in kubernetes
h
Thank you for your reply! Here is my error logs:
Copy code
2023-02-14T07:54:22.655851633Z Traceback (most recent call last):
2023-02-14T07:54:22.655857220Z   File "/usr/local/lib/python3.7/site-packages/bentoml/_internal/runner/runner_handle/remote.py", line 198, in async_run_method
2023-02-14T07:54:22.655875798Z     assert content_type.lower().startswith("application/vnd.bentoml.")
2023-02-14T07:54:22.655882503Z AssertionError
2023-02-14T07:54:22.655888230Z 
2023-02-14T07:54:22.655894306Z During handling of the above exception, another exception occurred:
2023-02-14T07:54:22.655901011Z 
2023-02-14T07:54:22.655907227Z Traceback (most recent call last):
2023-02-14T07:54:22.655913513Z   File "/usr/local/lib/python3.7/site-packages/bentoml/_internal/server/http_app.py", line 324, in api_func
2023-02-14T07:54:22.655920078Z     output = await api.func(input_data)
2023-02-14T07:54:22.655926783Z   File "/home/bentoml/bento/src/service.py", line 51, in predict
2023-02-14T07:54:22.655932929Z     batch_ret = await runner.async_run(**X)
2023-02-14T07:54:22.655939704Z   File "/usr/local/lib/python3.7/site-packages/bentoml/_internal/runner/runner.py", line 56, in async_run
2023-02-14T07:54:22.655945431Z     **kwargs,
2023-02-14T07:54:22.655951088Z   File "/usr/local/lib/python3.7/site-packages/bentoml/_internal/runner/runner_handle/remote.py", line 201, in async_run_method
2023-02-14T07:54:22.655956326Z     f"An unexpected exception occurred in remote runner {self._runner.name}: [{resp.status}] {body.decode()}"
2023-02-14T07:54:22.655962961Z UnicodeDecodeError: 'utf-8' codec can't decode byte 0x8b in position 1: invalid start byte
It seems there is something wrong when getting response from the remote runner but I have no idea why.
Copy code
assert content_type.lower().startswith("application/vnd.bentoml.")
b
Hello @Hsuan-Yu I have same issue, have you resolved it, could you please share if you know. thank you
c
cc @sauyon could you help take a look?
s
Huh. Does the code work when you run with
--production?
b
@sauyon the issue was due to setting some proxy vars, its ben resolved now.
s
Ah, great!