Teacher Forcing

Fact

A training trick that feeds the real previous answer to a sequence model.

In Plain Words

Teacher Forcing is karaoke with bossy lyrics. You sing 'banana' by mistake, but the screen still shows the real next line.

During training, the model gets the correct last step, not its own guess. This makes training faster and steadier in translation, chat, and speech AI.

Related Concepts

• Sequence-to-Sequence Model
• Autoregressive Model
• Recurrent Neural Network
• Cross-Entropy Loss

Seq2Seq
Teacher Forcing often trains the decoder and keeps early guesses from going wild.

Autoregressive Model
It teaches the model with real past steps before asking for the next one.

RNN
It was often used for early RNN sequence prediction.

Cross-Entropy Loss
The real next token is usually used to compute Cross-Entropy Loss.