https://bentoml.com logo
Join Slack
Powered by
This message was deleted.
# ask-for-help
s
This message was deleted.
b
Hello @Jakub Chledowski can you get it running locally?
s
Hi @Jakub Chledowski, you can see the server error by navigating to the "Replicas" tab and click on the first icon under the "Operation" column.
After the View Log UI is shown, you can navigate to the 
ipp-emb-extractor-2
container to see logs of your API Server.
From what I’ve seen in the logs, It seems like the error your ran into may be the following.
Copy code
2022-11-29T16:05:16.651379139Z 2022-11-29T16:05:16+0000 [ERROR] [api_server:1] Exception on /create_embeddings [POST] (trace=13ac673b782d0a6937ef495e9d84f398,span=d2a7c9140f00ddc0,sampled=0)
2022-11-29T16:05:16.651423316Z Traceback (most recent call last):
2022-11-29T16:05:16.651428636Z   File "/usr/local/lib/python3.8/site-packages/anyio/from_thread.py", line 45, in run
2022-11-29T16:05:16.651432930Z     asynclib = threadlocals.current_async_module
2022-11-29T16:05:16.651436672Z AttributeError: '_thread._local' object has no attribute 'current_async_module'
2022-11-29T16:05:16.651440480Z 
2022-11-29T16:05:16.651444005Z During handling of the above exception, another exception occurred:
2022-11-29T16:05:16.651448071Z 
2022-11-29T16:05:16.651451486Z Traceback (most recent call last):
2022-11-29T16:05:16.651454916Z   File "/usr/local/lib/python3.8/site-packages/bentoml/_internal/server/http_app.py", line 336, in api_func
2022-11-29T16:05:16.651458646Z     output = await run_in_threadpool(api.func, input_data)
2022-11-29T16:05:16.651462171Z   File "/usr/local/lib/python3.8/site-packages/starlette/concurrency.py", line 40, in run_in_threadpool
2022-11-29T16:05:16.651477830Z     return await loop.run_in_executor(None, func, *args)
2022-11-29T16:05:16.651481510Z   File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
2022-11-29T16:05:16.651485165Z     result = self.fn(*self.args, **self.kwargs)
2022-11-29T16:05:16.651488642Z   File "/home/bentoml/bento/src/service.py", line 96, in create_embeddings
2022-11-29T16:05:16.651492250Z     embeddings = runner.run(data_batch)
2022-11-29T16:05:16.651495798Z   File "/usr/local/lib/python3.8/site-packages/bentoml/_internal/runner/runner.py", line 46, in run
2022-11-29T16:05:16.651499366Z     return self.runner._runner_handle.run_method(  # type: ignore
2022-11-29T16:05:16.651502953Z   File "/usr/local/lib/python3.8/site-packages/bentoml/_internal/runner/runner_handle/remote.py", line 246, in run_method
2022-11-29T16:05:16.651506666Z     anyio.from_thread.run(
2022-11-29T16:05:16.651510150Z   File "/usr/local/lib/python3.8/site-packages/anyio/from_thread.py", line 47, in run
2022-11-29T16:05:16.651513740Z     raise RuntimeError("This function can only be run from an AnyIO worker thread")
2022-11-29T16:05:16.651517430Z RuntimeError: This function can only be run from an AnyIO worker thread
🏁 1
Open in Slack
PreviousNext
Powered by