Slackbot
08/11/2023, 8:42 PMVisaal Ambalam
08/11/2023, 8:42 PMVisaal Ambalam
08/11/2023, 8:58 PM@svc.on_deployment
def startup_service():
print(f"Initializing {SERVICE_NAME} with {MODEL_NAME}:{MODEL_VERSION}...")
stream_handler = logging.StreamHandler()
formatter = logging.Formatter(
"%(asctime)s - %(name)s - %(levelname)s - %(message)s"
)
stream_handler.setFormatter(formatter)
bentoml_logger = logging.getLogger("bentoml")
bentoml_logger.addHandler(stream_handler)
bentoml_logger.setLevel(logging.DEBUG)Jian Shen Yap
08/14/2023, 9:47 AMVisaal Ambalam
08/14/2023, 4:00 PM__init__ if the model weren’t running. I think it’s because bento pickles the initialized model when we call save_model so it doesn’t have to re-init each time it schedules it on a runner. Does that seem right?