Layer Normalization

Fact

A method that standardizes the features inside one data example.

In Plain Words

Layer Normalization is like seasoning each dish separately. You fix the salt in this one pan — the next order can be mild or spicy, it does not touch your work.

Transformers use it to keep training steady. Deep networks learn better when their numbers stop wobbling.

Related Concepts

• Batch Normalization
• Transformer architecture
• Optimization

Batch Normalization
Both steady training, but Layer Normalization does not use batch stats.

Transformer
Transformers often use Layer Normalization to keep deep layers steady.

Optimization
Layer Normalization makes training smoother and less wobbly.