Hi Everyone, Ive been using OpenLLM for a while now and I have been loving it. I want to know if there is a way to include API Tokens/Keys to manage access to my OpenLLM and also measure input and output token counts for usage metrics.

For this type of customization, I’d recommend modify the code from https://github.com/bentoml/BentoVLLM and add your token counting and access management logic