AI Rookies

Routing — Model Routing

Fact

A strategy that sends each request to the model that fits it best.

In Plain Words

Do not call the top chef for every snack. Model routing is like a host at the door. Easy orders go fast. Hard ones go to the expert.

It picks the path inside a multi-model product. It helps balance quality, cost, and speed.

Related Concepts

LLM
Model routing sends each request to the LLM that fits it best.

Inference
It decides which inference path a request will take.

Agent
An Agent often switches models across different steps.

LLMOps
Model routing is part of multi-model deployment and cost control.