AI Rookies

Ridge Regression

Fact

Linear regression that adds an L2 penalty to keep weights small.

In Plain Words

Ridge Regression is linear regression with a bungee cord on its pencil. It can draw a line, but wild swings get yanked back.

It keeps the model from trusting one clue too much. You meet it in table predictions, like house prices or sales.

Related Concepts

Regression
Ridge Regression is linear regression with an L2 penalty.

Regularization
It uses regularization to push large weights down.

Lasso
Ridge and Lasso both punish large weights, but Lasso can make weights zero.

Bias-Variance Tradeoff
Ridge Regression adds a little bias to get steadier predictions.