A backup model that handles requests when the main model is down.
A fallback model is the spare cashier who opens lane 3. The main line jams, and nobody has to glare at the candy rack.
It steps in during rush hours, outages, or usage limits. The app keeps answering instead of going dark.
Routing
Routing decides when a request moves to the fallback model.
LLMOps
LLMOps uses a fallback model to keep AI services running.
API
An API can hide the switch behind one call.
Cost-aware AI
Cost-aware AI can use a cheaper fallback model during busy times.