https://www.quantamagazine.org/tiny-language-models-thrive-with-gpt-4-as-a-teacher-20231005/
Tiny Language Models Come of Age
Ben Brubaker
10/5/23 10:50 AM
“To better understand how neural networks learn to simulate writing, researchers trained simpler versions on synthetic children’s stories.”