This message was deleted.
# ask-for-helps
Slackbot
09/29/2022, 6:59 PMThis message was deleted.
🍱 1
👀 1
s
Sean
09/30/2022, 12:05 AMCustom runners are quite flexible and should be able to support all Python model runtimes, see https://docs.bentoml.org/en/latest/concepts/runner.html#custom-model-runner. Some examples can be found in https://github.com/bentoml/BentoML/tree/main/examples/custom_model_runner
m
Matthieu Vanhoutte
09/30/2022, 6:09 AMHi @Sean thanks for you feedback! But how to load specific folder containing converted model by CTranslate2?
Matthieu Vanhoutte
09/30/2022, 3:16 PMHi @Sean, I managed to use it with custom runner. However, how can I specify
batchable=Truesave_models
Sean
10/04/2022, 9:50 AMGreat work!
batchable=True Copy code
@bentoml.Runnable.method(batchable=False)
def is_spam(self, input_data: NDArray[Any]) -> NDArray[Any]:
return self.classifier.predict(input_data)9 Views