This message was deleted.

Can you provide more detailed information? For example, what do you mean by 'async calls'?

Hi @Jiang for the ff:

async def myfunc...

Yeah. I mean, how do you call it?

asyncio.gather if there are many tasks or await my_func

So your question is how to do retry properly for an async function in Python?

@Jiang yes, in conjunction with bento

Ic. A BentoML endpoint is a regular Python function, so you can essentially do anything that Python itself can do inside it, and you don't need to do anything special in conjunction with Bento. Whatever you would normally do in regular Python can be done here as well.