baksh
02/25/2025, 12:06 PMJian Shen Yap
02/28/2025, 7:03 AMbaksh
03/03/2025, 5:11 AMbaksh
03/03/2025, 5:19 AMservice: 'service:OptimizedLLM'
labels:
owner: sandlogic
project: LLM
include:
- "**/*"
conda:
environment_yml: "./environment.yml"
envs:
- name: "GGML_CUDA"
value: "on"
- name: "LD_LIBRARY_PATH"
value: "$LD_LIBRARY_PATH:/lib/x86_64-linux-gnu"
docker:
distro: debian
python_version: "3.10"
cuda_version: "12.1"
system_packages:
- ffmpeg
- libomp-dev
i have attached the bentofile as well any help would be great