This message was deleted.

I got the solutions, seems like I would need to enable push gateway for prometheus as peon tasks are short lived.

That's right, peons can't be scraped, they need to push their metrics