large language model – Page 4 – Andrew Fairless, Ph.D.

What I Read: LLM evaluation

By Andrew Fairless on August 7, 2024May 25, 2024

https://huggingface.co/blog/clefourrier/llm-evaluation Let’s talk about LLM evaluationMay 23, 2024Clémentine Fourrier “There are, to my knowledge, at the moment, 3 main ways to do evaluation: automated benchmarking, using humans as judges, andContinue readingWhat I Read: LLM evaluation

What I Read: LLM, DSPy Assertions and Suggestions

By Andrew Fairless on August 6, 2024May 25, 2024

https://learnbybuilding.ai/tutorials/guiding-llm-output-with-dspy-assertions-and-suggestions Guiding LLM Output with DSPy Assertions and SuggestionsBill Chambers “Assertions in DSPy allow you to define strict rules and constraints that the LLM’s output must (or maybe that youContinue readingWhat I Read: LLM, DSPy Assertions and Suggestions

What I Read: Platonic Hypothesis

By Andrew Fairless on July 29, 2024May 24, 2024

https://phillipi.github.io/prh The Platonic Representation HypothesisMinyoung Huh, Brian Cheung, Tongzhou Wang, Phillip IsolaMITPosition Paper in ICML 2024 “Neural networks, trained with different objectives on different data and modalities, are converging toContinue readingWhat I Read: Platonic Hypothesis

What I Read: Game Theory, AI

By Andrew Fairless on July 25, 2024May 24, 2024

https://www.quantamagazine.org/game-theory-can-make-ai-more-correct-and-efficient-20240509 Game Theory Can Make AI More Correct and EfficientSteve NadisMay 9, 2024 “Researchers are drawing on ideas from game theory to improve large language models and make them moreContinue readingWhat I Read: Game Theory, AI

What I Read: LLMs, Open Source

By Andrew Fairless on July 15, 2024May 6, 2024

https://www.aidancooper.co.uk/how-to-beat-proprietary-llms How to Beat Proprietary LLMs With Smaller Open Source ModelsAidan CooperApr 26, 2024 “…we explore the unique advantages of open source LLMs, and how you can leverage them toContinue readingWhat I Read: LLMs, Open Source

What I Read: Structured Generation, Constrained Decoding

By Andrew Fairless on June 20, 2024April 16, 2024

https://www.aidancooper.co.uk/constrained-decoding A Guide to Structured Generation Using Constrained DecodingApr 8, 2024 “…there are techniques that ensure language models only return outputs that conform to your requirements. This article serves asContinue readingWhat I Read: Structured Generation, Constrained Decoding

What I Read: Attention, transformers

By Andrew Fairless on June 18, 2024April 16, 2024

Attention in transformers, visually explained | Chapter 6, Deep Learning3Blue1Brown “Demystifying attention, the key mechanism inside transformers and LLMs.”

What I Read: Data Selection, LLMs

By Andrew Fairless on June 12, 2024April 15, 2024

https://www.cs.princeton.edu/~smalladi/blog/2024/04/04/dataselection Using LESS Data to Tune Models: Data Selection in the Era of LLMsMengzhou Xia and Sadhika MalladiApril 04 2024 “We describe how data selection for modern-day LLMs differs fromContinue readingWhat I Read: Data Selection, LLMs

What I Read: Mamba Explained

By Andrew Fairless on June 10, 2024April 15, 2024

https://thegradient.pub/mamba-explained Mamba ExplainedKola Ayonrinde27.Mar.2024 “Mamba promises similar performance (and crucially similar scaling laws) as the Transformer whilst being feasible at long sequence lengths (say 1 million tokens).”

Tag: large language model