Is there a pattern in BentoML for responding immediately to long-running api calls and POSTing against a callback url when the process finishes or something that achieves the same effect (i.e. background jobs)?
j
Jian Shen Yap
03/17/2024, 9:25 PM
This is currently being scoped internally!
Currently you can hook a FastAPI background job or spawn a thread that runs in the background that executes your task.