software engineering – Page 3 – Andrew Fairless, Ph.D.

What I Read: Compound AI Systems

By Andrew Fairless on April 22, 2024March 1, 2024

https://bair.berkeley.edu/blog/2024/02/18/compound-ai-systems/ The Shift from Models to Compound AI SystemsMatei Zaharia, Omar Khattab, Lingjiao Chen, Jared Quincy Davis, Heather Miller, Chris Potts, James Zou, Michael Carbin, Jonathan Frankle, Naveen Rao, AliContinue readingWhat I Read: Compound AI Systems

What I Read: Scaling ChatGPT, Engineering Challenges

By Andrew Fairless on April 18, 2024March 1, 2024

https://newsletter.pragmaticengineer.com/p/scaling-chatgpt Scaling ChatGPT: Five Real-World Engineering ChallengesGergely OroszFeb 20, 2024 “Just one year after its launch, ChatGPT had more than 100M weekly users. In order to meet this explosive demand,Continue readingWhat I Read: Scaling ChatGPT, Engineering Challenges

What I Read: Deploy Model

By Andrew Fairless on April 9, 2024March 1, 2024

https://outerbounds.com/blog/the-many-ways-to-deploy-a-model/ The Many Ways to Deploy a ModelHamel Husain, The Outerbounds TeamFebruary 6, 2024 “Over the past years, we have been helping companies deploy a wildly diverse set of MLContinue readingWhat I Read: Deploy Model

What I Read: Type Checking

By Andrew Fairless on February 26, 2024January 25, 2024

https://vickiboykis.com/2023/12/11/why-if-type_checking/ Why if TYPE_CHECKING?Vicki BoykisDec 11 2023 “Typechecking by mypy is more meticulous than the checking that happens at runtime, so we have to do hacks in order to getContinue readingWhat I Read: Type Checking

What I Read: survey LLM tooling

By Andrew Fairless on February 8, 2024February 5, 2024

https://ericmjl.github.io/blog/2024/2/1/an-incomplete-and-opinionated-survey-of-llm-tooling/ An (incomplete and opinionated) survey of LLM toolingEric J. Ma1/31/24 7:00 PM “More critical than specifying specific tools, my goal with this blog post is to outline a frameworkContinue readingWhat I Read: survey LLM tooling

What I Read: SciPy builds for Python 3.12

By Andrew Fairless on January 25, 2024November 20, 2023

https://labs.quansight.org/blog/building-scipy-with-flang The ‘eu’ in eucatastrophe – Why SciPy builds for Python 3.12 on Windows are a minor miracleAxel ObermeierPublished November 8, 2023 “…behind the ordinary-seeming “SciPy released builds compatible withContinue readingWhat I Read: SciPy builds for Python 3.12

What I Read: vectorize wide PyTorch expressions

By Andrew Fairless on January 16, 2024November 7, 2023

https://probablymarcus.com/blocks/2023/10/19/vectorizing-wide-pytorch-expressions.html What happens when you vectorize wide PyTorch expressions?Marcus Lewis19 October 2023 “So we see that vectorization has three effects:It lets us keep the GPU busy even when inputs areContinue readingWhat I Read: vectorize wide PyTorch expressions

What I Read: GPU Computing

By Andrew Fairless on January 15, 2024November 7, 2023

https://codeconfessions.substack.com/p/gpu-computing What Every Developer Should Know About GPU ComputingAbhinav UpadhyayOct 18, 2023 “GPUs have become incredibly important because of their pervasive use in deep learning. Today, it is essential forContinue readingWhat I Read: GPU Computing

What I Read: LLM Apps, Data Pipelines

By Andrew Fairless on December 7, 2023November 20, 2023

https://meltano.com/blog/llm-apps-are-mostly-data-pipelines/ LLM Apps Are Mostly Data PipelinesPat NadolnyAugust 22 2023 “While the existing LLM app tools like LangChain and LlamaIndex are useful for building LLM apps… you should heavily considerContinue readingWhat I Read: LLM Apps, Data Pipelines

Tag: software engineering