Transfer Learning

Fact

A way to reuse what one model learned for a new task.

In Plain Words

Transfer learning is like a soccer kid trying basketball. The ball changed, but the footwork still helps.

Teams often start with a pretrained model. A little new data can teach it to sort tickets, read photos, or learn company tasks.

Related Concepts

• Pretraining
• Fine-tuning
• Foundation Model
• Bidirectional Encoder Representations from Transformers

Pretraining
Transfer learning often starts with general skills from pretraining.

Fine-tuning
Fine-tuning is a common way to move old skills to a new task.

Foundation-model
A stronger Foundation-model often needs less new data for the next task.

BERT
BERT helped make pretraining plus transfer learning normal in NLP.