Hello, I am using BentoML v1.1.11. I am trying to monitor how much GPU one of my BentoML runners is using by creating a custom runner from it that, in addition to completing the runner's original task, executes a background task for gathering the metrics that can run indefinitely until the service ends.
What is the best approach to achieving this? I have found that using Python's threading package works, but I would like to ideally do it without the use of threads. I have tried asyncio and anyio but both resulted in issues.