Hi! I am interested in creating an infrastructure for monitoring machine learning models running in production and am very intrigued with what Pinot has to offer. I had some questions regarding my use case and it would be great to hear some feedback before I get started. 1. I want to monitor input features & output predictions - here I am essentially interested in anomaly detection and it appears ThirdEye answers this 2. I am interested in calculating business KPIs (precision, recall, accuracy, etc.) once labels are available - is it possible to do during ingestion? Is it possible to run custom scripts (python?) to calculate KPIs during ingest? 3. Visualization - I would like the ability to see data in dashboards as well as slice & dice. What tools are available for this? Thanks in advance for the assistance!

• Yes, thirdeye will work for anomaly detection and rca • custom scripts - Python is not supported, you can run groovy scripts. • visualization - superset

Thanks @Kishore G. Regarding custom scripts, do you have any insights as to how Minion will work? What about Upsert on Stream Ingest, can additional logic be added?

you can add additional logic as long as it does not depend on the previous record for the same key