software engineering – Page 2 – Andrew Fairless, Ph.D.

What I Read: Shapes, Matrix Multiplications

By Andrew Fairless on February 27, 2025November 16, 2024

https://www.thonking.ai/p/what-shapes-do-matrix-multiplications What Shapes Do Matrix Multiplications Like?Horace HeApr 01, 2024 “It has become tribal knowledge that the particular shapes chosen for matmuls has a surprisingly large effect on their performance.Continue readingWhat I Read: Shapes, Matrix Multiplications

What I Read: uv, Python, production

By Andrew Fairless on February 3, 2025October 19, 2024

https://pythonspeed.com/articles/uv-python-production Should you use uv’s managed Python in production?by Itamar Turner-TrauringLast updated 15 Oct 2024 “The uv Python packaging tool provides fast replacements for tools like pip… one of itsContinue readingWhat I Read: uv, Python, production

What I Read: LLM Agents in Production

By Andrew Fairless on December 17, 2024December 16, 2024

https://www.zenml.io/blog/llm-agents-in-production-architectures-challenges-and-best-practices LLM Agents in Production: Architectures, Challenges, and Best PracticesAlex Strick van LinschotenDec 9, 2024 “Taken together, the LLMOps case studies paint a picture of a technology that is atContinue readingWhat I Read: LLM Agents in Production

What I Read: Difference, Statements and Expressions

By Andrew Fairless on November 14, 2024August 26, 2024

The Difference Between Statements and Expressions The Difference Between Statements and ExpressionsWritten by Jeremy Grifski inJune 28, 2019Last Updated May 27, 2024 “Unfortunately, while the definitions I’ve provided are cleanContinue readingWhat I Read: Difference, Statements and Expressions

What I Read: LLM evaluation

By Andrew Fairless on October 21, 2024July 22, 2024

https://hamel.dev/blog/posts/evals Your AI Product Needs EvalsHow to construct domain-specific LLM evaluation systems.Hamel HusainMarch 29, 2024 “…I’ve seen many successful and unsuccessful approaches to building LLM products. I’ve found that unsuccessfulContinue readingWhat I Read: LLM evaluation

What I Read: Data Flywheels, LLM

By Andrew Fairless on October 17, 2024July 20, 2024

https://www.sh-reya.com/blog/ai-engineering-flywheel Data Flywheels for LLM ApplicationsShreya ShankarJul 1, 2024 “This diagram illustrates my (idealized) architecture of an LLM pipeline, from input processing through evaluation and logging. It showcases ideas I’llContinue readingWhat I Read: Data Flywheels, LLM

What I Read: bare metal to 70B

By Andrew Fairless on September 25, 2024July 8, 2024

https://imbue.com/research/70b-infrastructure From bare metal to a 70B model: infrastructure set-up and scriptsThe Imbue TeamJune 25, 2024 “…we trained a 70B parameter model from scratch on our own infrastructure that outperformedContinue readingWhat I Read: bare metal to 70B

What I Read: Structured Generation, LLMs

By Andrew Fairless on September 19, 2024July 8, 2024

https://blog.dottxt.co/coding-for-structured-generation.html Coding For Structured Generation with LLMsWill Kurt2024-06-21 “In this post we’re going to go through an example that shows not only how to use structured generation in your LLMContinue readingWhat I Read: Structured Generation, LLMs

What I Read: AI Engineers, Search

By Andrew Fairless on September 18, 2024June 29, 2024

https://softwaredoug.com/blog/2024/06/25/what-ai-engineers-need-to-know-search What AI Engineers Should Know about SearchDoug TurnbullJune 25th, 2024 “Things AI Engineers Should Know about Search”

Tag: software engineering