Andrew Fairless – Page 13 – Andrew Fairless, Ph.D.

What I Read: Mamba, Easy Way

By Andrew Fairless on May 9, 2024March 7, 2024

https://jackcook.com/2024/02/23/mamba.html Mamba: The Easy WayJack CookFebruary 23, 2024 “Mamba appears to outperform similarly-sized Transformers while scaling linearly with sequence length…. If… you’re looking for a higher-level overview of Mamba’s bigContinue readingWhat I Read: Mamba, Easy Way

What I Read: How fast process CSV file

By Andrew Fairless on May 8, 2024March 7, 2024

https://datapythonista.me/blog/how-fast-can-we-process-a-csv-file How fast can we process a CSV fileMarc GarciaThu 22 February 2024 “…we’ll see in this blog post how to process a CSV file as fast as possible.”

What I Read: impute income, opinion polls

By Andrew Fairless on May 7, 2024March 7, 2024

How to code and impute income in studies of opinion polls? How to code and impute income in studies of opinion polls?Andrew Gelman3/2/24 9:43 AM “What’s your preferred way toContinue readingWhat I Read: impute income, opinion polls

What I Read: Mamba

By Andrew Fairless on May 1, 2024March 7, 2024

https://jameschen.io/jekyll/update/2024/02/12/mamba.html Mamba No. 5 (A Little Bit Of…)James ChenFeb 12, 2024 “…I attempt to provide a walkthrough of the essence of the Mamba state space model architecture, occasionally sacrificing someContinue readingWhat I Read: Mamba

What I Read: Structured State Space Sequence Models

By Andrew Fairless on April 30, 2024March 7, 2024

https://cnichkawde.github.io/statespacesequencemodels.html Beyond Transformers: Structured State Space Sequence ModelsChetan NichkawdeJanuary 22, 2024 “A new paradigm is rapidly evolving within the realm of sequence modeling that presents a marked advancement over theContinue readingWhat I Read: Structured State Space Sequence Models

What I Read: Forgetting Can Help AI Learn

By Andrew Fairless on April 29, 2024March 1, 2024

https://www.quantamagazine.org/how-selective-forgetting-can-help-ai-learn-better-20240228/ How Selective Forgetting Can Help AI Learn BetterAmos Zeeberg2/28/24 10:38 AM “Erasing key information during training results in machine learning models that can learn new languages faster and moreContinue readingWhat I Read: Forgetting Can Help AI Learn

What I Read: Predictive Human Preference, Model Ranking to Model Routing

By Andrew Fairless on April 25, 2024March 1, 2024

https://huyenchip.com//2024/02/28/predictive-human-preference.html Predictive Human Preference: From Model Ranking to Model RoutingChip Huyen2/27/24 7:00 PM “A challenge of building AI applications is choosing which model to use…. What if we can predictContinue readingWhat I Read: Predictive Human Preference, Model Ranking to Model Routing

What I Read: Diffusion Model theory

By Andrew Fairless on April 23, 2024March 1, 2024

https://ayandas.me/2024/blog/diffusion-theory-from-scratch/ Building Diffusion Model’s theory from ground upAyan DasMay 7, 2024 “…we will go back and revisit the ‘fundamental ingredients’ behind the SDE formulation, and show how the idea canContinue readingWhat I Read: Diffusion Model theory

What I Read: Compound AI Systems

By Andrew Fairless on April 22, 2024March 1, 2024

https://bair.berkeley.edu/blog/2024/02/18/compound-ai-systems/ The Shift from Models to Compound AI SystemsMatei Zaharia, Omar Khattab, Lingjiao Chen, Jared Quincy Davis, Heather Miller, Chris Potts, James Zou, Michael Carbin, Jonathan Frankle, Naveen Rao, AliContinue readingWhat I Read: Compound AI Systems

What I Read: Scaling ChatGPT, Engineering Challenges

By Andrew Fairless on April 18, 2024March 1, 2024

https://newsletter.pragmaticengineer.com/p/scaling-chatgpt Scaling ChatGPT: Five Real-World Engineering ChallengesGergely OroszFeb 20, 2024 “Just one year after its launch, ChatGPT had more than 100M weekly users. In order to meet this explosive demand,Continue readingWhat I Read: Scaling ChatGPT, Engineering Challenges

Author: Andrew Fairless