https://lightning.ai/lightning-ai/studios/code-lora-from-scratch Code LoRA from ScratchSebastian Raschka “LoRA, which stands for Low-Rank Adaptation, is a popular technique to finetune LLMs more efficiently,,,. This Studio explains how LoRA works by coding it
What I Read: Differentiable Trees
https://ericmjl.github.io/blog/2023/8/7/journal-club-differentiable-search-of-evolutionary-trees/ Journal Club: Differentiable Search of Evolutionary TreesEric J. Ma2023-08-07 “…how the authors take a non-differentiable problem and turn it into a differentiable problem through interconversion between mathematical data structures.”
What I Read: To Understand Transformers, Focus on Attention
https://drscotthawley.github.io/blog/posts/Transformers1-Attention.html To Understand Transformers, Focus on AttentionScott H. HawleyAugust 21, 2023 “To Understand Transformers, Focus on Attention”