An AI lesson: general computing often beats hand-written expert rules.
The Bitter Lesson is a chess match. A master's clever tricks look smarter. But once compute is cheap, a machine that just searches more wins anyway.
In AI, general methods win as data and compute grow. It helps you pick the better AI bet.
Scaling-law
The Bitter Lesson explains why scalable computing keeps getting stronger.
Deep Learning
Deep Learning follows this path: fewer rules, more data, and more compute.
Symbolic AI
The Bitter Lesson warns that hand-written knowledge can lose to scalable learning.
Feature-engineering
The Bitter Lesson turns hand-made features from the star into a helper.