Scaling is all you need

Sutton's Bitter Lesson

• Transformers and Attention are a detail… the real gains in AI came from scaling.