This message was deleted.

Hey again 🙂 I think this is actually really similar to regular infra observability - have to get signals from when the model or application is deployed to monitor it. In ML, we do spend so much time looking at model performance in training but it’s important to remember that models degrade over time in production and performance isn’t static. In the regular devops world, we would never just run unit tests and then not monitor the system in the real world. It’s time for ML to grow up 🌶️