Technology · #AI · #MachineLearning · #Technology · #DeepLearning
The Bitter Lesson: Why Hard-Coded AI Always Loses to Learning
In AI research, a recurring pattern shows that methods relying on built-in human knowledge eventually get overtaken by simple algorithms that learn from raw computation. This is 'the bitter lesson'.
Chess: Handcrafted vs Learned
The Pattern Repeats
In speech recognition, researchers spent decades on phonetic rules. Then deep learning simply trained on massive data and outperformed all hand-crafted systems. The same happened in computer vision: engineered features lost to learned features.
The bitter lesson is that the 70 years of AI research have taught us that methods that leverage computation are ultimately the most effective, and by a large margin.
Rich Sutton
Why We Keep Forgetting
Researchers are tempted to build in human knowledge because it feels like progress. But this actually limits the system to what we already know. The more we let the AI discover its own representations, the more powerful it becomes—even if it uses cruder methods.
Go: AlphaGo's Surprising Moves
Implication for AI Safety
If we build AIs with hard-coded goals and rules, they may fail in unexpected ways. The bitter lesson suggests we should instead focus on scalable learning algorithms that can adapt, even if their behavior is less interpretable.
We must learn the bitter lesson that building in our knowledge is a dead end. The only way to win is to let the machine learn.
Unknown