transformer – Page 4 – Andrew Fairless, Ph.D.

What I Read: LLM research

By Andrew Fairless on October 10, 2023September 4, 2023

https://huyenchip.com//2023/08/16/llm-research-open-challenges.html Open challenges in LLM research8/15/23 8:00 PM “Never before in my life had I seen so many smart people working on the same goal: making LLMs better… I noticedContinue readingWhat I Read: LLM research

What I Read: Multimodal, Embeddings

By Andrew Fairless on October 5, 2023September 4, 2023

https://app.twelvelabs.io/blog/multimodal-embeddings The Multimodal Evolution of Vector EmbeddingsJames LeAugust 9, 2023 “…companies collect and feed hundreds of millions of terabytes of multimodal data into deep learning models. As a result, embeddings…Continue readingWhat I Read: Multimodal, Embeddings

What I Read: Attention Off By One

By Andrew Fairless on September 13, 2023September 4, 2023

https://www.evanmiller.org/attention-is-off-by-one.html Attention Is Off By OneBy Evan MillerJuly 24, 2023 “…the current generation of AI models have an off-by-one error in a crucial place, and it’s making everyone’s Transformer modelsContinue readingWhat I Read: Attention Off By One

What I Read: LLMs

By Andrew Fairless on September 7, 2023August 1, 2023

https://willthompson.name/what-we-know-about-llms-primer What We Know About LLMs (Primer)Will Thompson (Twitter)July 23, 2023 “…it is worth reflecting on what we concretely know about LLMs at this point in time and how theseContinue readingWhat I Read: LLMs

What I Read: Accelerating PyTorch

By Andrew Fairless on September 6, 2023August 1, 2023

https://magazine.sebastianraschka.com/p/accelerating-pytorch-model-training Accelerating PyTorch Model TrainingUsing Mixed-Precision and Fully Sharded Data ParallelismSebastian Raschka, PhDJun 26, 2023 “…how to scale PyTorch model training with minimal code changes. The focus here is onContinue readingWhat I Read: Accelerating PyTorch

What I Read: What, Why ChatGPT

By Andrew Fairless on July 12, 2023June 15, 2023

https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/ What Is ChatGPT Doing … and Why Does It Work?February 14, 2023Stephen Wolfram “That ChatGPT can automatically generate something that reads even superficially like human-written text is remarkable, andContinue readingWhat I Read: What, Why ChatGPT

What I Read: In-Context Learning

By Andrew Fairless on July 11, 2023May 31, 2023

https://thegradient.pub/in-context-learning-in-context/ In-Context Learning, In ContextDaniel Bashir29.Apr.2023 “…in-context learning (ICL). In this paradigm, an LLM learns to solve a new task at inference time (without any change to its weights) byContinue readingWhat I Read: In-Context Learning

What I Read: Against LLM

By Andrew Fairless on June 29, 2023May 31, 2023

https://explosion.ai/blog/against-llm-maximalism Against LLM maximalismby Matthew HonnibalMay 18, 2023 “However, LLMs are not a direct solution to most of the NLP use-cases companies have been working on… if you want toContinue readingWhat I Read: Against LLM

What I Read: Few Shot, Recommenders, LLMs

By Andrew Fairless on May 30, 2023May 1, 2023

https://blog.reachsumit.com/posts/2023/04/llm-for-recsys/ Zero and Few Shot Recommender Systems based on Large Language ModelsSumit Kumar2023-04-10 “Many researchers have recently proposed different approaches to building recommender systems using LLMs. These methods convert differentContinue readingWhat I Read: Few Shot, Recommenders, LLMs

Tag: transformer