New ways to solve AI problems better or with less computing power.
Same race car. A smarter driving trick wins the race. No bigger engine needed.
Algorithmic innovation finds better ways to train and run AI. It can make models faster and cheaper.
Scaling-law
New algorithms can change how fast AI improves with more data and computing power.
Optimization
Optimization often gives people new ways to build better algorithms.
Transformer
The Transformer is a famous algorithm breakthrough in modern AI.