A smaller language model that needs less memory and computing power.
An SLM is like a zippy scooter for quick errands. It will not move a couch, but it starts fast.
It often runs on your device or a small service. It fits daily tasks with quick replies and low cost.
LLM
An SLM is the same kind of tool as an LLM, but lighter and cheaper to run.
Local-LLM
An SLM is easier to run locally because it needs less from the device.
Quantization
Quantization can shrink an SLM even more, so it is easier to run.
Distillation
Distillation can move skills from a large model into a smaller model.