https://pythonspeed.com/articles/slow-numba The wrong way to speed up your code with Numbaby Itamar Turner-Trauring21 Mar 2024 “If your NumPy-based code is too slow, you can sometimes use Numba to speed itContinue readingWhat I Read: speed up code, Numba
https://arxiv.org/abs/2402.17764 The Era of 1-bit LLMs: All Large Language Models are in 1.58 BitsShuming Ma, Hongyu Wang, Lingxiao Ma, Lei Wang, Wenhui Wang, Shaohan Huang, Li Dong, Ruiping Wang, JilongContinue readingWhat I Read: 1-bit LLMs, 1.58 Bits
https://www.quantamagazine.org/how-selective-forgetting-can-help-ai-learn-better-20240228/ How Selective Forgetting Can Help AI Learn BetterAmos Zeeberg2/28/24 10:38 AM “Erasing key information during training results in machine learning models that can learn new languages faster and moreContinue readingWhat I Read: Forgetting Can Help AI Learn
https://newsletter.pragmaticengineer.com/p/scaling-chatgpt Scaling ChatGPT: Five Real-World Engineering ChallengesGergely OroszFeb 20, 2024 “Just one year after its launch, ChatGPT had more than 100M weekly users. In order to meet this explosive demand,Continue readingWhat I Read: Scaling ChatGPT, Engineering Challenges
https://www.quantamagazine.org/the-computing-pioneer-helping-ai-see-20231024/ The Computing Pioneer Helping AI SeeSusan D’AgostinoOctober 24, 2023 ““Patches of color and brightness require us to connect what we’re seeing now to our memory…”… machines see what isContinue readingWhat I Read: Helping AI See
https://lilianweng.github.io/posts/2023-06-23-agent/ LLM Powered Autonomous AgentsLilian WengJune 23, 2023 “Building agents with LLM (large language model) as its core controller is a cool concept…. it can be framed as a powerfulContinue readingWhat I Read: LLM Agents
SQLite: Past, Present, and Future SQLite: Past, Present, and FutureSaturday, September 24, 2022 “Being designed as an OLTP database, SQLite employs row-oriented execution… However, there is a growing need forContinue readingWhat I Read: SQLite
https://www.aidancooper.co.uk/pandas-anti-patterns/ 4 Pandas Anti-Patterns to Avoid and How to Fix ThemAidan Cooper “This post highlights four common pandas anti-patterns and outlines a complementary set of techniques that you should useContinue readingWhat I Read: Pandas Anti-Patterns
https://lilianweng.github.io/lil-log/2021/09/24/train-large-neural-networks.html How to Train Really Large Models on Many GPUs?Sep 24, 2021Lilian Weng “How to train large and deep neural networks is challenging, as it demands a large amount ofContinue readingWhat I Read: How to Train Really Large Models