Decision Tree

Fact

A tree-shaped model asks yes-or-no questions step by step to predict an answer.

In Plain Words

A decision tree is like a school cafeteria line. Pizza or tacos? Milk or juice? Small questions lead to one tray.

It can sort things into groups or predict numbers. It is easy to explain, but too many splits can make it memorize the homework.

Related Concepts

• Classification and Regression Tree
• Classification Task
• Regression
• Gradient Boosting

CART
CART is the most common and classic way to build a Decision Tree.

Classification
A Decision Tree can do Classification by sending items into groups.

Regression
A Decision Tree can do Regression by predicting numbers, like house prices.

Gradient Boosting
Gradient Boosting often links many small Decision Trees to get better results.