https://thegradient.pub/othello/ Do Large Language Models learn world models or just surface statistics?Kenneth Li21.Jan.2023 “Large Language Models (LLM) are on fire…. How do these models achieve this kind of performance? Do
What I Read: More Flexible Machine Learning
https://www.quantamagazine.org/researchers-discover-a-more-flexible-approach-to-machine-learning-20230207/ Researchers Discover a More Flexible Approach to Machine LearningSteve NadisFebruary 7, 2023 ““Liquid” neural nets, based on a worm’s nervous system, can transform their underlying algorithms on the fly,
What I Read: Machines Learn, Teach Basics
https://www.quantamagazine.org/machines-learn-better-if-we-teach-them-the-basics-20230201/ Machines Learn Better if We Teach Them the BasicsMax G. LevyFebruary 1, 2023 “A wave of research improves reinforcement learning algorithms by pre-training them as if they were human.”
What I Read: Optimizing Machine Learning Training Pipelines
https://medium.com/ntropy-network/bag-of-tricks-for-optimizing-machine-learning-training-pipelines-4f8d5cd3d432 Bag of tricks for optimizing machine learning training pipelinesArseny KravchenkoJan 5 “…we are constantly looking for ways to improve the efficiency of our machine learning pipelines, while keeping the