Hi, I have a compatibility issue with the transiti...
# ask-for-helpm
Matěj Šmíd
07/17/2024, 9:04 AMHi, I have a compatibility issue with the transition from older decorated functions and runners API to the new class based API.
The old API, e.g.
Copy code
@svc.api(
input=JSON(pydantic_model=S3BucketAndKeys),
output=JSON(pydantic_model=ListOfPoseEstimationResults),
)
def func(s3_objects):
... Copy code
<http://requests.post|requests.post>(url, headers={'accept': 'application/json'}, data='{....}') Copy code
@bentoml.service()
class Service:
@bentoml.api()
def func(self, s3_objects: S3BucketAndKeys) -> ListOfPoseEstimationResults:
...s3_objects Copy code
<http://requests.post|requests.post>(url, data='{"s3_objects": ...}')c
Chaoyu
07/17/2024, 5:25 PMyes, you can achieve the same behavior, see https://docs.bentoml.com/en/latest/guides/iotypes.html#pydantic
Chaoyu
07/17/2024, 5:25 PM Copy code
from pydantic import BaseModel, Field
import typing as t
import bentoml
class AdsGenerationParams(BaseModel):
prompt: str = Field(description="The prompt text")
industry: str = Field(description="The industry the company belongs to")
target_audience: str = Field(description="Target audience for the advertisement")
temperature: float = Field(default=0.0, description="A sampling temperature between 0 and 2")
@bentoml.service
class AdsWriter:
@bentoml.api(input_spec=AdsGenerationParams)
def generate(self, **params: t.Any) -> str:
# Access parameters from the request
prompt = params['prompt']
industry = params['industry']
target_audience = params['target_audience']
temperature = params['temperature']
# Use the parameters in your Service logic
# Implementation logic
...m
Matěj Šmíd
07/18/2024, 5:12 PMThanks! Works as expected.