https://huggingface.co/blog/matryoshka Introduction to Matryoshka Embedding ModelsTom AarsenJoshuaOmar SansevieroFebruary 23, 2024 “…Kusupati et al. (2022) were inspired to create embedding models whose embeddings could reasonably be shrunk without suffering too much
What I Read: Kalman Filter
https://www.youtube.com/watch?v=-DiZGpAh7T4 Kalman Filter – VISUALLY EXPLAINED!Kapil Sachdeva “This tutorial explains the Kalman Filter from Bayesian Probabilistic View and as a special case of Bayesian Filtering.”
What I Read: How Machines ‘Grok’ Data
https://www.quantamagazine.org/how-do-machines-grok-data-20240412 How Do Machines ‘Grok’ Data?Anil Ananthaswamy4/12/24 “By apparently overtraining them, researchers have seen neural networks discover novel solutions to problems.”
What I Read: Attention, transformers
Attention in transformers, visually explained | Chapter 6, Deep Learning3Blue1Brown “Demystifying attention, the key mechanism inside transformers and LLMs.”