https://www.quantamagazine.org/tiny-language-models-thrive-with-gpt-4-as-a-teacher-20231005/ Tiny Language Models Come of AgeBen Brubaker10/5/23 10:50 AM “To better understand how neural networks learn to simulate writing, researchers trained simpler versions on synthetic children’s stories.”
What I Read: AI’s $200B Question
Follow the GPUs Perspective AI’s $200B QuestionBy David CahnPublished September 20, 2023 “GPU capacity is getting overbuilt. Long-term, this is good. Short-term, things could get messy.”