cost – Andrew Fairless, Ph.D.

What I Read: 1-bit LLMs, 1.58 Bits

By Andrew Fairless on May 14, 2024March 11, 2024

https://arxiv.org/abs/2402.17764 The Era of 1-bit LLMs: All Large Language Models are in 1.58 BitsShuming Ma, Hongyu Wang, Lingxiao Ma, Lei Wang, Wenhui Wang, Shaohan Huang, Li Dong, Ruiping Wang, JilongContinue readingWhat I Read: 1-bit LLMs, 1.58 Bits

What I Read: Nvidia AI Supremacy Temporary

By Andrew Fairless on October 25, 2023October 5, 2023

https://petewarden.com/2023/09/10/why-nvidias-ai-supremacy-is-only-temporary/ Why Nvidia’s AI Supremacy is Only TemporarySeptember 10, 2023Pete Warden “…hopefully I’ve made a convincing case that there are strong structural reasons behind Nvidia’s success. Here’s how I seeContinue readingWhat I Read: Nvidia AI Supremacy Temporary

What I Learn: neural scaling, data pruning

By Andrew Fairless on April 11, 2023February 22, 2023

https://arxiv.org/abs/2206.14486 Beyond neural scaling laws: beating power law scaling via data pruningBen Sorscher, Robert Geirhos, Shashank Shekhar, Surya Ganguli, Ari S. Morcos[Submitted on 29 Jun 2022 (v1), last revised 15Continue readingWhat I Learn: neural scaling, data pruning

What I Read: How Train Large Deep Learning Models

By Andrew Fairless on November 8, 2021October 24, 2021

https://www.assemblyai.com/blog/how-to-train-large-deep-learning-models-as-a-startup/ How to Train Large Deep Learning Models as a StartupDylan FoxOct 7, 2021Training large deep learning models is expensive and slow. Yet, startups are all about iterating fast. InContinue readingWhat I Read: How Train Large Deep Learning Models

What I Read: SwAV method

By Andrew Fairless on August 2, 2021July 12, 2021

https://m0nads.wordpress.com/2021/01/08/the-swav-method/ The SwAV methodAntonio Ferraioli “The SwAV method is a clustering-based online method whose goal is to learn visual features in an online fashion without supervision.”

What I Read: Building a Gigascale ML Feature Store

By Andrew Fairless on February 18, 2021January 18, 2021

https://doordash.engineering/2020/11/19/building-a-gigascale-ml-feature-store-with-redis/ Building a Gigascale ML Feature Store with Redis, Binary Serialization, String Hashing, and CompressionNovember 19, 2020 21 Minute Read Data, Machine Learning 36Arbaz Khan Zohaib Sibte Hassan “When aContinue readingWhat I Read: Building a Gigascale ML Feature Store

What I Read: Revisiting Sutton’s Bitter Lesson for AI

By Andrew Fairless on February 15, 2021January 18, 2021

https://blog.exxactcorp.com/compute-goes-brrr-revisiting-suttons-bitter-lesson-artificial-intelligence/ Deep LearningCompute Goes Brrr: Revisiting Sutton’s Bitter Lesson for Artificial IntelligenceMarketing, October 27, 2020 “The main driver of AI progress, according to Sutton, is the increasing availability of computeContinue readingWhat I Read: Revisiting Sutton’s Bitter Lesson for AI

What I Read: US Government Will Pay Doctors to Use AI Algorithms

By Andrew Fairless on February 13, 2021January 14, 2021

https://www.wired.com/story/us-government-pay-doctors-use-ai-algorithms/ Tom SimoniteBusiness11.10.2020 07:00 AMThe US Government Will Pay Doctors to Use These AI AlgorithmsThe artificial intelligence programs can diagnose eye disease in diabetics and complications in stroke patients. “TheContinue readingWhat I Read: US Government Will Pay Doctors to Use AI Algorithms

What I Read: Why is life expectancy in the US lower?

By Andrew Fairless on February 12, 2021January 14, 2021

https://ourworldindata.org/us-life-expectancy-low Why is life expectancy in the US lower than in other rich countries?by Max RoserOctober 29, 2020 “Why do Americans have a lower life expectancy than people in otherContinue readingWhat I Read: Why is life expectancy in the US lower?

What I Read: How balance drug prices and innovation (part 2)

By Andrew Fairless on January 30, 2021January 5, 2021

https://theincidentaleconomist.com/wordpress/how-other-countries-balance-drug-prices-and-innovation-part-2/ How other countries balance drug prices and innovation (part 2)by Liam BendicksenOctober 5 2020 2:02 PM “Across party lines, Americans generally agree that prescription drug prices in the USContinue readingWhat I Read: How balance drug prices and innovation (part 2)

Tag: cost