Have you tried the LangChain 🦜 and WhyLabs whybot integration yet? You can add ML monitoring to your LLMs in just a couple extra lines of code 🤯 You can check out the notebook on GitHub! https://github.com/whylabs/langkit/blob/main/langkit/examples/Langchain_OpenAI_LLM_Monitoring_with_WhyLabs.ipynb