Hi everyone, as an operation and maintenance perso...
# ask-for-help
z
Hi everyone, as an operation and maintenance personnel, I have just come into contact with bentoml and I have a question I would like to ask. My bentoml version is 1.2.10. I use the official example BentoBlip. I built it into an image and can access it normally by running it using docker. When I deploy it to kubernes with kubeflow, an error occurs:
Copy code
File "/usr/local/bin/bentoml", line 8, in <module>
    sys.exit(cli())
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.10/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/bentoml_cli/utils.py", line 377, in wrapper
    return func(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/click/decorators.py", line 33, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/bentoml_cli/utils.py", line 348, in wrapper
    return_value = func(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/bentoml_cli/start.py", line 479, in start_runner_server
    start_runner_server_impl(
  File "/usr/local/lib/python3.10/site-packages/simple_di/__init__.py", line 139, in _
    return func(*_inject_args(bind.args), **_inject_kwargs(bind.kwargs))
  File "/usr/local/lib/python3.10/site-packages/bentoml/start.py", line 64, in start_runner_server
    for runner in svc.runners:
AttributeError: 'Service' object has no attribute 'runners'
My deployment file is:
Copy code
apiVersion: <http://resources.yatai.ai/v1alpha1|resources.yatai.ai/v1alpha1>
kind: Bento
metadata:
  name: bento-blip-demo
  namespace: kubeflow
spec:
  tag: blip_image_captioning:bufsixhxw2iybyit
  image: easzlab.io.local:5000/blip_image_captioning:bufsixhxw2iybyit
  runners:
  - name: bento-blip-demo-0
    runnableType: XGBoost
---
apiVersion: <http://serving.yatai.ai/v2alpha1|serving.yatai.ai/v2alpha1>
kind: BentoDeployment
metadata:
  name: bento-blip-demo
  namespace: kubeflow
spec:
  bento: bento-blip-demo
  ingress:
    enabled: false
  resources:
    limits:
        cpu: 20000m
        memory: "40Gi"
    requests:
        cpu: 10000m
        memory: "20Gi"
  autoscaling:
    maxReplicas: 5
    minReplicas: 1
    metrics:
    - type: Resource
      resource:
        name: cpu
        target:
          type: Utilization
          averageUtilization: 60
  runners:
  - name: bento-blip-demo-0
    resources:
      limits:
        cpu: 20000m
        memory: "40Gi"
      requests:
        cpu: 10000m
        memory: "20Gi"
    autoscaling:
      maxReplicas: 2
      minReplicas: 1
In the same situation, I deployed the official BentoML example and it ran normally. I have been troubleshooting this problem all day and have no clue. I hope you can help me, thank you!