Custom LLM not requesting responses

Incident Report for Retell AI

Resolved

The incident has been resolved. We are adding more testing and processes around custom LLM to prevent this from happening again.

Posted Dec 13, 2024 - 03:23 PST

Monitoring

We have identified that a bad release caused the custom LLM cluster to not send out any requests for responses, leading to voice agents not responding. This is only impacting custom LLM agents.

We have traced down to the root cause of the issue and is applying a fix.

Posted Dec 13, 2024 - 00:15 PST