https://newsletter.maartengrootendorst.com/p/a-visual-guide-to-mamba-and-state A Visual Guide to Mamba and State Space ModelsMaarten GrootendorstFeb 19, 2024 “To further improve LLMs, new architectures are developed that might even outperform the Transformer architecture. One of
What I Read: Convolutions, Probability
https://www.countbayesie.com/blog/2022/11/30/understanding-convolutions-in-probability-a-mad-science-perspective Understanding Convolutions in Probability: A Mad-Science PerspectiveWill Kurt, Count BayesieDecember 01, 2022 “If you’ve ever done much mad science you’ll know that a major problem is selectively determining the
What I Read: Beyond Message Passing, Graph Neural Networks
https://thegradient.pub/graph-neural-networks-beyond-message-passing-and-weisfeiler-lehman/ Beyond Message Passing: a Physics-Inspired Paradigm for Graph Neural NetworksMichael Bronstein07.May.2022 “…the “node and edge-centric” mindset of current graph deep learning schemes imposes strong limitations… we propose physics-inspired “continuous”
What I Read: Understanding Convolutions on Graphs
https://distill.pub/2021/understanding-gnns/ Understanding Convolutions on GraphsUnderstanding the building blocks and design choices of graph neural networks.Ameya DaigavaneBalaraman RavindranGaurav AggarwalGoogle ResearchSept. 2, 202110.23915/distill.00032 “Graph neural networks (GNNs) are a family of neural