H, Is there a way to use flash_attn with betnoml? ...
# ask-for-help
y
H, Is there a way to use flash_attn with betnoml? My build fails due to the package installation order. Flash attention requires first an installation of torch and ninja followed by the flash_attn installation. Build error:
Copy code
`flash-attn@2.7.2.post1`
depends on `torch`, but doesn't declare it as a build dependency. If
`flash-attn` is a first-party package, consider adding `torch` to its
`build-system.requires`. Otherwise, `uv pip install torch` into the
environment and re-run with `--no-build-isolation`.
bentofile.yaml:
Copy code
service: "service:Embeddings"
labels:
  owner: data-competence-center
  project: gallery
include:
- "*.py"
python:
  packages:
   - ninja
   - torch
   - flash_attn
   - bentoml
docker:
  python_version: "3.11"