Inductive Bias

Fact

The built-in guesses a model uses before it learns from data.

In Plain Words

It is like a detective at a missing-cookie scene. He checks the dog first, not Grandma.

It shapes what a model learns fastest. It matters most with little data and in model design.

Related Concepts

• Convolutional Neural Network
• Transformer architecture
• Bias-Variance Tradeoff
• Statistical Learning Theory

CNN
Inductive bias in CNNs favors nearby patterns and the same pattern in new spots.

Transformer
A Transformer has its own design guesses built into it.

Bias-Variance Tradeoff
Stronger inductive bias can lower variance but raise bias.

SLT
SLT studies how inductive bias helps models work on new data.