ze jing
04/11/2024, 12:18 PMFile "/usr/local/bin/bentoml", line 8, in <module>
sys.exit(cli())
File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
return self.main(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1078, in main
rv = self.invoke(ctx)
File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/local/lib/python3.10/site-packages/click/core.py", line 783, in invoke
return __callback(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/bentoml_cli/utils.py", line 377, in wrapper
return func(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/click/decorators.py", line 33, in new_func
return f(get_current_context(), *args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/bentoml_cli/utils.py", line 348, in wrapper
return_value = func(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/bentoml_cli/start.py", line 479, in start_runner_server
start_runner_server_impl(
File "/usr/local/lib/python3.10/site-packages/simple_di/__init__.py", line 139, in _
return func(*_inject_args(bind.args), **_inject_kwargs(bind.kwargs))
File "/usr/local/lib/python3.10/site-packages/bentoml/start.py", line 64, in start_runner_server
for runner in svc.runners:
AttributeError: 'Service' object has no attribute 'runners'
My deployment file is:
apiVersion: <http://resources.yatai.ai/v1alpha1|resources.yatai.ai/v1alpha1>
kind: Bento
metadata:
name: bento-blip-demo
namespace: kubeflow
spec:
tag: blip_image_captioning:bufsixhxw2iybyit
image: easzlab.io.local:5000/blip_image_captioning:bufsixhxw2iybyit
runners:
- name: bento-blip-demo-0
runnableType: XGBoost
---
apiVersion: <http://serving.yatai.ai/v2alpha1|serving.yatai.ai/v2alpha1>
kind: BentoDeployment
metadata:
name: bento-blip-demo
namespace: kubeflow
spec:
bento: bento-blip-demo
ingress:
enabled: false
resources:
limits:
cpu: 20000m
memory: "40Gi"
requests:
cpu: 10000m
memory: "20Gi"
autoscaling:
maxReplicas: 5
minReplicas: 1
metrics:
- type: Resource
resource:
name: cpu
target:
type: Utilization
averageUtilization: 60
runners:
- name: bento-blip-demo-0
resources:
limits:
cpu: 20000m
memory: "40Gi"
requests:
cpu: 10000m
memory: "20Gi"
autoscaling:
maxReplicas: 2
minReplicas: 1
In the same situation, I deployed the official BentoML example and it ran normally.
I have been troubleshooting this problem all day and have no clue. I hope you can help me, thank you!