metric – Andrew Fairless, Ph.D.

What I Read: LLM judge

By Andrew Fairless on February 25, 2025November 9, 2024

https://hamel.dev/blog/posts/llm-judge Creating a LLM-as-a-Judge That Drives Business ResultsHamel HusainOctober 29, 2024 “Earlier this year, I wrote Your AI product needs evals. Many of you asked, “How do I get startedContinue readingWhat I Read: LLM judge

What I Read: LLM evaluation

By Andrew Fairless on August 7, 2024May 25, 2024

https://huggingface.co/blog/clefourrier/llm-evaluation Let’s talk about LLM evaluationMay 23, 2024Clémentine Fourrier “There are, to my knowledge, at the moment, 3 main ways to do evaluation: automated benchmarking, using humans as judges, andContinue readingWhat I Read: LLM evaluation

What I Read: data, product teams

By Andrew Fairless on April 20, 2023March 30, 2023

https://blog.duolingo.com/growth-model-duolingo/ Meaningful metrics: How data sharpened the focus of product teamsby Erin GustafsonFebruary 17, 2023 “Our Data Science team developed a growth framework that helped to grow DAUs by 4xContinue readingWhat I Read: data, product teams

Tag: metric