Contemporary · Worldview & Futurism · Essay
The Scaling Hypothesis
Gwern Branwen · 2020
"Intelligence may emerge from scaling up compute and data. GPT-3 shows the hypothesis holds."
Gwern Branwen's essay explaining why Deep Learning took over AI. The 'Scaling Hypothesis' posits that simply throwing exponentially more compute and data at simple neural network architectures (like Transformers) will inevitably lead to Artificial General Intelligence (AGI).
Read more about the topic
Up NextSuggested: Continues the theme of Worldview & Futurism
The Next Big Thing Will Start Out Looking Like a Toy
"Disruptive innovations are dismissed as toys because they underperform on established metrics while excelling on new ones."
Chris Dixon · EssayContinue→