Andrew Fairless – Page 19 – Andrew Fairless, Ph.D.

What I Read: Attention Off By One

By Andrew Fairless on September 13, 2023September 4, 2023

https://www.evanmiller.org/attention-is-off-by-one.html Attention Is Off By OneBy Evan MillerJuly 24, 2023 “…the current generation of AI models have an off-by-one error in a crucial place, and it’s making everyone’s Transformer modelsContinue readingWhat I Read: Attention Off By One

What I Read: Few-Shot Learning

By Andrew Fairless on September 12, 2023September 4, 2023

https://saturncloud.io/blog/breaking-the-data-barrier-how-zero-shot-one-shot-and-few-shot-learning-are-transforming-machine-learning/ Breaking the Data Barrier: How Zero-Shot, One-Shot, and Few-Shot Learning are Transforming Machine LearningBy Christophe AttenWednesday, May 17, 2023 “The improvements made over the last almost two decades haveContinue readingWhat I Read: Few-Shot Learning

What I Read: What Do LLMs Know About Linguistics?

By Andrew Fairless on September 11, 2023August 1, 2023

https://thegradient.pub/what-do-llms-know-about-linguistics-it-depends-on-how-you-ask/ What Do LLMs Know About Linguistics? It Depends on How You AskTerra Blevins7/9/23 1:00 PM “… LLMs are highly sensitive to how the prompt is written…. We explore theContinue readingWhat I Read: What Do LLMs Know About Linguistics?

What I Read: LLMs

By Andrew Fairless on September 7, 2023August 1, 2023

https://willthompson.name/what-we-know-about-llms-primer What We Know About LLMs (Primer)Will Thompson (Twitter)July 23, 2023 “…it is worth reflecting on what we concretely know about LLMs at this point in time and how theseContinue readingWhat I Read: LLMs

What I Read: Accelerating PyTorch

By Andrew Fairless on September 6, 2023August 1, 2023

https://magazine.sebastianraschka.com/p/accelerating-pytorch-model-training Accelerating PyTorch Model TrainingUsing Mixed-Precision and Fully Sharded Data ParallelismSebastian Raschka, PhDJun 26, 2023 “…how to scale PyTorch model training with minimal code changes. The focus here is onContinue readingWhat I Read: Accelerating PyTorch

What I Read: Perspectives on diffusion

By Andrew Fairless on August 30, 2023July 30, 2023

https://sander.ai/2023/07/20/perspectives.html Perspectives on diffusionSander DielemanJuly 20, 2023 “Diffusion models appear to come in many shapes and forms…. these various perspectives each reveal new connections and are a breeding ground forContinue readingWhat I Read: Perspectives on diffusion

What I Read: shape of AGI

By Andrew Fairless on August 29, 2023July 30, 2023

https://windowsontheory.org/2023/07/17/the-shape-of-agi-cartoons-and-back-of-envelope/?1 The shape of AGI: Cartoons and back of envelopeBoaz BarakJuly 17, 2023 “AIs are not “silicon humans.””

What I Read: What we don’t talk about

By Andrew Fairless on August 28, 2023July 30, 2023

https://veekaybee.github.io/2023/07/18/what-we-dont-talk-about-when-we-talk-about-building-ai-apps/ What we don’t talk about when we talk about building AI appsVicki Boykis7/17/23 8:00 PM “From the technical perspective, here’s what we don’t discuss when we talk about deepContinue readingWhat I Read: What we don’t talk about

What I Read: speed up Python with Rust

By Andrew Fairless on August 24, 2023July 30, 2023

https://pythonspeed.com/articles/easiest-rust-python/ The easiest way to speed up Python with RustItamar Turner-Trauring7/9/23 8:00 PM “If you want to speed up some existing Python code, writing a compiled extension in Rust canContinue readingWhat I Read: speed up Python with Rust

Author: Andrew Fairless