Lucas
04/15/2024, 3:28 PMbentoml 1.1.7 .
Save model:
import bentoml
from transformers import AutoImageProcessor, AutoModelForImageClassification
preprocessor = AutoImageProcessor.from_pretrained("rizvandwiki/gender-classification")
model = AutoModelForImageClassification.from_pretrained("rizvandwiki/gender-classification")
bentoml.transformers.save_model('gender-classifier-preprocessor', preprocessor)
bentoml.transformers.save_model('gender-classifier-model', model)
bentofile:
service: 'service:svc'
include:
- '*'
python:
requirements_txt: requirements.txt
models:
- gender-classifier-preprocessor:latest
- gender-classifier-model:latest
Service:
import bentoml
from bentoml.io import Image, NumpyNdarray
preprocessor_runner = bentoml.transformers.get("gender-classifier-preprocessor").to_runner()
model_runner = bentoml.transformers.get("gender-classifier-model").to_runner()
svc = bentoml.Service("gender-classifier", runners=[preprocessor_runner, model_runner])
@svc.api(input=Image(), output=NumpyNdarray())
def gender_classifier(img: Image):
inputs = preprocessor_runner.run(img, return_tensors="pt")
predictions = model_runner.run(inputs["pixel_values"])
return predictions.numpy()
And I'm getting an error: bentoml.exceptions.MissingDependencyException: None (reason: No module named 'tensorflow') But there no mention of tensorflow anywhere in my codeSuhas
04/16/2024, 8:25 AM