Jeremy
03/06/2026, 2:07 PMAI Evy
03/06/2026, 2:07 PMAI Evy
03/06/2026, 2:08 PM500) . [(1) ]()
To set this up:
1. Navigate to the Alerting tab in your dashboard
2. Create an alert rule with:
- **Metric**: API Error Count
- **Error Code Filter**: Filter by specific HTTP status codes (e.g., 500)
- **Threshold type**: Absolute
- **Threshold value**: 2 (or your desired count)
- **Comparator**: Greater than
- **Evaluation window and frequency**: Choose based on your needs
3. Configure notification channels (email addresses and/or webhook URLs)
However, the API Error Count metric tracks API errors generally—it's not explicitly documented whether this captures webhook triggering failures specifically (like the 500 errors you see in call logs when your server rejects the webhook request) .
If you need more granular monitoring of webhook failures specifically, you may want to implement monitoring on your own server side, since webhook errors like "Request failed with status code 500" indicate your server is returning that error. [(2) ]()AI Evy
03/06/2026, 2:08 PMAI Evy
03/06/2026, 2:08 PMAI Evy
03/06/2026, 2:11 PMJeremy
03/06/2026, 3:45 PMAI Evy
03/06/2026, 3:45 PMAI Evy
03/06/2026, 3:45 PM429, 402) . [(1) ]() Make sure you're using the actual numeric codes—`400` for Bad Request and 500 for Internal Server Error—rather than the text descriptions.
2. Evaluation Window vs Frequency
With a 30-minute evaluation window, supported frequencies are 5 minutes, 30 minutes, or 1 hour. Your 5-minute frequency is valid, but the alert evaluates the metric over the entire 30-minute window. If your 3 bad requests occurred within a short timeframe, they should be captured within that window.
3. Incident Lifecycle
Notifications are sent only when a new incident is created, not on each evaluation. If an alert was previously triggered and is still active, you won't receive repeated notifications. Check the Alerting tab for any active incidents.
4. What API Error Count Tracks
The API Error Count metric tracks errors from Retell API requests—this may not include webhook triggering failures where your server returns an error. The webhook errors you're seeing ("Request failed with status code 500") indicate your server is returning that error to Retell, which is different from Retell's API returning errors.
Recommended next steps:
- Verify the error code filter uses numeric codes (400, 500)
- Check the Alerting tab for any existing active incidents
- Confirm the errors you triggered are Retell API errors, not webhook response errors from your serverAI Evy
03/06/2026, 3:45 PMAI Evy
03/06/2026, 3:45 PMJeremy
03/06/2026, 3:46 PMAI Evy
03/06/2026, 3:46 PMAI Evy
03/06/2026, 3:47 PM404
2. The threshold is set to trigger when count is greater than 1 (meaning 2+ errors)
3. No existing active incident for this alert rule (notifications are sent only when a new incident is created)
If you still haven't received an alert, verify:
- The error code filter specifically includes 404 as a numeric code
- Check the Alerting tab for any active incidents—if one already exists, you won't receive repeated notifications
- Confirm these are Retell API errors, not webhook response errors from your own serverAI Evy
03/06/2026, 3:47 PMAI Evy
03/06/2026, 3:47 PMJeremy
03/06/2026, 3:51 PMAI Evy
03/06/2026, 3:51 PMAI Evy
03/06/2026, 3:51 PMAI Evy
03/06/2026, 3:51 PMAI Evy
03/06/2026, 3:51 PMJeremy
03/06/2026, 6:47 PMAI Evy
03/06/2026, 6:47 PMAI Evy
03/06/2026, 6:47 PMAI Evy
03/06/2026, 6:47 PMAI Evy
03/06/2026, 6:47 PMJeremy
03/11/2026, 4:35 PMAI Evy
03/11/2026, 4:35 PMAI Evy
03/11/2026, 4:35 PMAI Evy
03/11/2026, 4:35 PMAI Evy
03/11/2026, 4:35 PM