large language model – Andrew Fairless, Ph.D.

What I Read: Toy Models of Superposition

By Andrew Fairless on December 19, 2024September 29, 2024

https://transformer-circuits.pub/2022/toy_model/index.html Toy Models of SuperpositionNelson Elhage, Tristan Hume, Catherine Olsson, Nicholas Schiefer, Tom Henighan, Shauna Kravec, Zac Hatfield-Dodds, Robert Lasenby, Dawn Drain, Carol Chen, Roger Grosse, Sam McCandlish, Jared Kaplan,Continue readingWhat I Read: Toy Models of Superposition

What I Read: LLM Agents in Production

By Andrew Fairless on December 17, 2024December 16, 2024

https://www.zenml.io/blog/llm-agents-in-production-architectures-challenges-and-best-practices LLM Agents in Production: Architectures, Challenges, and Best PracticesAlex Strick van LinschotenDec 9, 2024 “Taken together, the LLMOps case studies paint a picture of a technology that is atContinue readingWhat I Read: LLM Agents in Production

What I Watch: How LLMs store facts

By Andrew Fairless on December 16, 2024September 3, 2024

How might LLMs store facts | Chapter 7, Deep Learning3Blue1BrownAug 31, 2024 “Unpacking the multilayer perceptrons in a transformer, and how they may store facts”

What I Read: Fine-tuning

By Andrew Fairless on December 11, 2024September 3, 2024

https://openpipe.ai/blog/fine-tuning-best-practices-series-introduction-and-chapter-1-training-data Fine-tuning Best Practices Series Introduction and Chapter 1: Training DataReid MayoAug 1, 2024 “We’ll explore how to choose the best data, common methods for collecting it, and common methodsContinue readingWhat I Read: Fine-tuning

What I Read: passively learned, causality

By Andrew Fairless on December 4, 2024August 26, 2024

What can be passively learned about causality?Simons InstituteAndrew Lampinen (Google DeepMind)Jun 25, 2024 “What could language models learn about causality and experimentation from their passive training?”

What I Read: Evaluating LLM-Evaluators

By Andrew Fairless on December 3, 2024August 26, 2024

https://eugeneyan.com/writing/llm-evaluators Evaluating the Effectiveness of LLM-Evaluators (aka LLM-as-Judge)Eugene Yan “After reading this, you’ll gain an intuition on how to apply, evaluate, and operate LLM-evaluators. We’ll learn when to apply (i)Continue readingWhat I Read: Evaluating LLM-Evaluators

What I Read: Classifying pdfs

By Andrew Fairless on November 21, 2024August 26, 2024

https://snats.xyz/pages/articles/classifying_a_bunch_of_pdfs.html Classifying all of the pdfs on the internetSantiago Pedroza2024-08-18 “How would you classify all the pdfs in the internet? Well, that is what I tried doing this time.”

What I Read: Tool Retrieval, RAG

By Andrew Fairless on November 20, 2024August 26, 2024

https://jxnl.co/writing/2024/08/21/trade-off-tool-selection Optimizing Tool Retrieval in RAG Systems: A Balanced ApproachJason Liu2024/08/21 “When it comes to Retrieval-Augmented Generation (RAG) systems, one of the key challenges is deciding how to select andContinue readingWhat I Read: Tool Retrieval, RAG

What I Read: LLM Pre-training Post-training

By Andrew Fairless on November 18, 2024August 26, 2024

https://magazine.sebastianraschka.com/p/new-llm-pre-training-and-post-training New LLM Pre-training and Post-training ParadigmsA Look at How Modern LLMs Are TrainedSebastian Raschka, PhDAug 17, 2024 “Initially, the LLM training process focused solely on pre-training, but it hasContinue readingWhat I Read: LLM Pre-training Post-training

What I Read: Open-endedness, Agentic AI

By Andrew Fairless on November 13, 2024August 25, 2024

https://press.airstreet.com/p/open-endedness-is-all-well-need Open-endedness is all we’ll need: On “Agentic AI”Air Street Capital, Nathan Benaich, and Alex ChalmersAug 15, 2024 “Agentic systems offer the promise of agents – a software system thatContinue readingWhat I Read: Open-endedness, Agentic AI

Tag: large language model