What I Read: Against Naive AI Scaling

https://jacobbuckman.com/2022-06-14-an-actually-good-argument-against-naive-ai-scaling/

An Actually-Good Argument Against Naive AI Scaling
Jacob Buckman
Posted on June 14, 2022


“…the debate is whether scaled-up language models in the style of GPT-3 will eventually become general intelligences, or whether we will hit some fundamental limits…. My position is that continuing to scale language models under the current paradigm will give us massive but not unbounded capabilities.”