https://evjang.com/2021/12/17/lang-generalization.html
To Understand Language is to Understand Generalization
Eric Jang
Dec 17, 2021
“We all want ML models to generalize better, but defining “generalization” is hard. I suggest that the structure of language is the structure of generalization. If language models also capture the underlying structure of generalization vis-à-vis language, then perhaps we can use language models to “bolt generalization” onto non-verbal domains, such as robotics.”