https://blog.alexalemi.com/kl-is-all-you-need.html KL is All You NeedAlexander A. Alemi2024-01-08 “…the core of essentially all modern machine learning methods is a single universal objective: Kullback-Leibler (KL) divergence minimization…. Understand KL, understand the
What I Read: Linear Algebra, Random
https://youtu.be/6htbyY3rH1w?si=IXTrcoIReps_ftFq Is the Future of Linear Algebra.. Random?Mutual Information “Randomization is arguably the most exciting and innovative idea to have hit linear algebra in a long time.”
What I Read: Chatbots Understand Text
https://www.quantamagazine.org/new-theory-suggests-chatbots-can-understand-text-20240122/ New Theory Suggests Chatbots Can Understand TextAnil Ananthaswamy1/22/24 “Far from being “stochastic parrots,” the biggest large language models seem to learn enough skills to understand the words they’re processing.”