February 2025 – Andrew Fairless, Ph.D.

What I Read: Shapes, Matrix Multiplications

By Andrew Fairless on February 27, 2025November 16, 2024

https://www.thonking.ai/p/what-shapes-do-matrix-multiplications What Shapes Do Matrix Multiplications Like?Horace HeApr 01, 2024 “It has become tribal knowledge that the particular shapes chosen for matmuls has a surprisingly large effect on their performance.Continue readingWhat I Read: Shapes, Matrix Multiplications

What I Read: benchmark

By Andrew Fairless on February 26, 2025November 9, 2024

Run a benchmark they said. It will be fun they said. | PyData Amsterdam 2024Vincent D. WarmerdamOct 22, 2024 “This is the story of a fun idea that turned intoContinue readingWhat I Read: benchmark

What I Read: LLM judge

By Andrew Fairless on February 25, 2025November 9, 2024

https://hamel.dev/blog/posts/llm-judge Creating a LLM-as-a-Judge That Drives Business ResultsHamel HusainOctober 29, 2024 “Earlier this year, I wrote Your AI product needs evals. Many of you asked, “How do I get startedContinue readingWhat I Read: LLM judge

What I Read: degree certainty

By Andrew Fairless on February 24, 2025November 9, 2024

https://blog.alexalemi.com/a-degree-of-certainty.html A Degree of CertaintyAlexander A. Alemi2024-08-14 “None of the common ways to measure proabilities are statistically uniform. What do I mean by this? Not all 1% changes in probabilityContinue readingWhat I Read: degree certainty

What I Read: probability generating

By Andrew Fairless on February 20, 2025November 9, 2024

https://entropicthoughts.com/probability-generating-functions Probability-Generating FunctionsChris2024-10-29 “I have long struggled with understanding what probability-generating functions are and how to intuit them. There were two pieces of the puzzle missing for me, and we’llContinue readingWhat I Read: probability generating

What I Read: data migrations

By Andrew Fairless on February 19, 2025November 9, 2024

https://yorickpeterse.com/articles/building-a-better-and-scalable-system-for-data-migrations Building a better and scalable system for data migrationsYorick PeterseOctober 24, 2024 “I’ve been thinking about what a better solution to data migrations might look like for a while,Continue readingWhat I Read: data migrations

What I Read: myths, randomisation

By Andrew Fairless on February 18, 2025November 9, 2024

https://www.bps.org.uk/psychologist/dispelling-myths-about-randomisation Dispelling myths about randomisation14 October 2024 “The first myth is that randomisation works because it balances confounders…. This leads to the second myth, which is that we should testContinue readingWhat I Read: myths, randomisation

What I Read: Sampling, SQL

By Andrew Fairless on February 17, 2025October 25, 2024

https://blog.moertel.com/posts/2024-08-23-sampling-with-sql.html Sampling with SQLTom MoertelAugust 23, 2024 “Sampling is one of the most powerful tools you can wield to extract meaning from large datasets…. If you know how to takeContinue readingWhat I Read: Sampling, SQL

What I Read: Gaussians

By Andrew Fairless on February 13, 2025October 25, 2024

https://gestalt.ink/gaussians Understanding Gaussians “The Gaussian distribution, or normal distribution is a key subject in statistics, machine learning, physics, and pretty much any other field that deals with data and probability.”

What I Read: evaluation quicksand

By Andrew Fairless on February 12, 2025October 25, 2024

https://www.interconnects.ai/p/building-on-evaluation-quicksand Building on evaluation quicksandNathan LambertOct 16, 2024 “In my article on “Big Tech’s LLM evals are just marketing,” I didn’t uncover the deeper reasons as to why can’t fullyContinue readingWhat I Read: evaluation quicksand

Month: February 2025