Yanick Schraner
12/11/2024, 8:53 AM`flash-attn@2.7.2.post1`
depends on `torch`, but doesn't declare it as a build dependency. If
`flash-attn` is a first-party package, consider adding `torch` to its
`build-system.requires`. Otherwise, `uv pip install torch` into the
environment and re-run with `--no-build-isolation`.
bentofile.yaml:
service: "service:Embeddings"
labels:
owner: data-competence-center
project: gallery
include:
- "*.py"
python:
packages:
- ninja
- torch
- flash_attn
- bentoml
docker:
python_version: "3.11"