:red_circle: HIGH SEV · API Observation Agent Cron...
# alarms-prod
a
🔴 HIGH SEV · API Observation Agent Cron Not Firing 🔥 ozone-api has not been asked to run the observation agent in 90 minutes <|📈 graph> · <|📊 service dashboard> · 🚨 alarm definition · 🔕 silence _Nothing has POSTed /cron/runObservationAgent for 90 minutes. The Render cron job 'Run Observation Agent (production)' is scheduled '30 * * * *', so a 90 minute window always contains at least one firing — an empty window means the job itself is suspended, deleted, failing before it reaches us, or its CRON_JOBS_API_KEY no longer authenticates. This is the only rule that catches the scheduler being dead. 'API Observation Agent Run Failures' counts failures, so it stays silent forever if no runs are attempted at all, and 'API Observation Agent Produced Nothing' takes a day to notice. noDataState and execErrState are Alerting because absence is the condition — same reasoning as 'API Serving No Requests'. Firing outside 0500 0700 in every family timezone is expected to be harmless: the endpoint is still hit hourly and returns familiesQueued 0. So this rule is about the request arriving, not about work being done. Check the cron job on the Render dashboard first, then whether the API is serving at all._ Grafana vmain-b1e6358