Slackbot
05/03/2023, 8:05 AMAshish Singh
05/03/2023, 1:19 PMclass Model(BaseModel):
__root__: list[str]
@svc.api(input=JSON(pydantic_model=Model), output=NumpyNdarray())
def predict_bentoml(input_data: Model) -> np.ndarray:
pass
Lennard Berger
05/03/2023, 1:21 PMAshish Singh
05/03/2023, 1:21 PMAshish Singh
05/03/2023, 1:28 PMIODescriptor
, which is why I think using primitive type might not work.
class InferenceAPI:
def __init__(
self,
user_defined_callback: t.Callable[..., t.Any] | None,
input_descriptor: IODescriptor[t.Any],
output_descriptor: IODescriptor[t.Any],
name: Optional[str],
doc: Optional[str] = None,
route: Optional[str] = None,
):