https://huyenchip.com//2024/02/28/predictive-human-preference.html Predictive Human Preference: From Model Ranking to Model RoutingChip Huyen2/27/24 7:00 PM “A challenge of building AI applications is choosing which model to use…. What if we can predict
What I Read: Chatbots Understand Text
https://www.quantamagazine.org/new-theory-suggests-chatbots-can-understand-text-20240122/ New Theory Suggests Chatbots Can Understand TextAnil Ananthaswamy1/22/24 “Far from being “stochastic parrots,” the biggest large language models seem to learn enough skills to understand the words they’re processing.”
What I Read: Nvidia, GPU gold rush
https://blog.johnluttig.com/p/nvidia-envy-understanding-the-gpu Nvidia Envy: understanding the GPU gold rushJohn LuttigNov 10, 2023 “In 2023, thousands of companies and countries begged Nvidia to purchase more GPUs. Can the exponential demand endure?”
What I Read: Tiny Language Models
https://www.quantamagazine.org/tiny-language-models-thrive-with-gpt-4-as-a-teacher-20231005/ Tiny Language Models Come of AgeBen Brubaker10/5/23 10:50 AM “To better understand how neural networks learn to simulate writing, researchers trained simpler versions on synthetic children’s stories.”