Hi Shaked, you should be able to do validation on the input dataframe in the service api definition code, and it’s recommended to validate input before passing it to the runner
Chaoyu
01/26/2023, 9:00 AM
I’m not sure I understood your first question. The actual scoring happens inside the runner process. BentoML passes the entire dataframe to the runner. And when adaptive batching is enabled, it may group multiple data frames into one and pass it to the model for scoring