Hello Everyone, I was using the command Bentoml Bu...
# ask-for-help
b
Hello Everyone, I was using the command Bentoml Build after building whenever i containerize it by default the service is starting with worker=2 can you please help me out here
j
the default workers is equivalent to the core of your CPU. You can explicitly set it to 1 in the configuration
b
thankyou Jain
In configuration i have explicitly defined workers as 1, with bentoml build and bentoml containerize i have built docker image but when i run the container running with workers 2
Copy code
service: 'service:OptimizedLLM'
labels:
  owner: sandlogic
  project: LLM
include:
  - "**/*"
conda:
  environment_yml: "./environment.yml"
envs:
  - name: "GGML_CUDA"
    value: "on"
  - name: "LD_LIBRARY_PATH"
    value: "$LD_LIBRARY_PATH:/lib/x86_64-linux-gnu"
docker:
    distro: debian
    python_version: "3.10"
    cuda_version: "12.1"
    system_packages:
      - ffmpeg
      - libomp-dev
i have attached the bentofile as well any help would be great