evaluation – Andrew Fairless, Ph.D.

What I Read: Bayesian Mixed Models

By Andrew Fairless on March 26, 2025December 8, 2024

https://towardsdatascience.com/evaluating-bayesian-mixed-models-in-r-python-27d344a03016?gi=e23f7abbacbf Evaluating Bayesian Mixed Models in R/PythonEduardo Coronado SrokaJul 3, 2020 “…model checking and evaluation are just one of those things you can’t (and shouldn’t) avoid… Yet, I think inContinue readingWhat I Read: Bayesian Mixed Models

What I Read: benchmark

By Andrew Fairless on February 26, 2025November 9, 2024

Run a benchmark they said. It will be fun they said. | PyData Amsterdam 2024Vincent D. WarmerdamOct 22, 2024 “This is the story of a fun idea that turned intoContinue readingWhat I Read: benchmark

What I Read: LLM judge

By Andrew Fairless on February 25, 2025November 9, 2024

https://hamel.dev/blog/posts/llm-judge Creating a LLM-as-a-Judge That Drives Business ResultsHamel HusainOctober 29, 2024 “Earlier this year, I wrote Your AI product needs evals. Many of you asked, “How do I get startedContinue readingWhat I Read: LLM judge

What I Read: LLM evaluation

By Andrew Fairless on August 7, 2024May 25, 2024

https://huggingface.co/blog/clefourrier/llm-evaluation Let’s talk about LLM evaluationMay 23, 2024Clémentine Fourrier “There are, to my knowledge, at the moment, 3 main ways to do evaluation: automated benchmarking, using humans as judges, andContinue readingWhat I Read: LLM evaluation

What I Read: How Quickly LLMs Learn Skills?

By Andrew Fairless on April 10, 2024March 1, 2024

How Quickly Do Large Language Models Learn Unexpected Skills?Stephen Ornes2/13/24 10:32 AM “A new study suggests that so-called emergent abilities actually develop gradually and predictably, depending on how you measureContinue readingWhat I Read: How Quickly LLMs Learn Skills?

Tag: evaluation