An AI provider goes down in the middle of peak season
- The challenge
It’s the week before Christmas, and a retailer’s AI assistant is answering thousands of customer questions every hour. Then its model provider slows down and starts returning errors. Without a backup plan, chat and ticket handling grind to a halt.
- How izz.ONE solves it
Status Check spots the rising response times within seconds. The Gateway moves every request to an approved model of equal quality, and IT Operations gets an alert in Teams. Once the provider is stable again, traffic shifts back step by step.
- The result
Not a single customer noticed the outage. The team heard about it from an alert, not from complaints.
For developers: Failover rules
Failover targets are set per application and respect region and data classification.
failover:
app: service-assistant
primary: anthropic/claude-sonnet@eu
fallback:
- azure-openai/gpt-4.1@swedencentral
- mistral/large@eu
trigger:
p95_latency_ms: 3000
error_rate: 0.05
notify: [teams:it-betrieb]