Fine-tuning

Fact

Training an existing model more with specific data to fit a task.

In Plain Words

Fine-tuning is boot camp for a smart new hire. They come back knowing your weird forms and Slack slang.

It helps with repeat work in one style or field. It is not a magic wish fountain.

Related Concepts

• Pretraining
• Foundation Model
• Reinforcement Learning from Human Feedback
• Model Distillation

Pretraining
Fine-tuning comes after Pretraining and keeps adjusting the model.

Foundation-model
Fine-tuning helps a Foundation-model fit a specific task.

RLHF
RLHF is often used during Fine-tuning to teach preferences.

Distillation
Distillation can move Fine-tuning gains into a smaller model.