https://epochai.org/blog/the-direct-approach The Direct ApproachMatthew Barnett and Tamay Besiroglu “Empirical scaling laws can help predict the cross-entropy loss associated with training inputs, such as compute and data. However, in order to
What I Read: Giant Steps Can Solve Optimization Faster
https://www.quantamagazine.org/risky-giant-steps-can-solve-optimization-problems-faster-20230811/ Risky Giant Steps Can Solve Optimization Problems FasterAllison ParshallAugust 11, 2023 “New results break with decades of conventional wisdom for the gradient descent algorithm.”
What I Read: LLM-based Products
https://eugeneyan.com/writing/llm-patterns/ Patterns for Building LLM-based Systems & Productseugeneyan “This post is about practical patterns for integrating large language models (LLMs) into systems and products.”
What I Read: Few-Shot Learning
https://saturncloud.io/blog/breaking-the-data-barrier-how-zero-shot-one-shot-and-few-shot-learning-are-transforming-machine-learning/ Breaking the Data Barrier: How Zero-Shot, One-Shot, and Few-Shot Learning are Transforming Machine LearningBy Christophe AttenWednesday, May 17, 2023 “The improvements made over the last almost two decades have