This message was deleted.

Can you add a readiness probe to detect whether the model is successfully loaded?

yes model is loaded when api arrives, only problem is model is not pre-loaded which is some time consuming

Oh, I see what you mean, so wouldn't it be better to put the model loading logic in the readiness probe, so that the model will be loaded into memory when the pod is ready?

i am not sure, about readiness probe on bentoml v0.13.1, can i specify somewhere?? maybe an example?

Can u customize the readiness probe??