https://blog.kjamistan.com/how-memorization-happens-novelty.html How memorization happens: Novelty09 Dezember 2024 “…repeated text and images incentivize training data memorization, but that’s not the only training data that machine learning models memorize. Let’s take a
What I Read: How Machines ‘Grok’ Data
https://www.quantamagazine.org/how-do-machines-grok-data-20240412 How Do Machines ‘Grok’ Data?Anil Ananthaswamy4/12/24 “By apparently overtraining them, researchers have seen neural networks discover novel solutions to problems.”
What I Read: Few-Shot Learning
https://saturncloud.io/blog/breaking-the-data-barrier-how-zero-shot-one-shot-and-few-shot-learning-are-transforming-machine-learning/ Breaking the Data Barrier: How Zero-Shot, One-Shot, and Few-Shot Learning are Transforming Machine LearningBy Christophe AttenWednesday, May 17, 2023 “The improvements made over the last almost two decades have
What I Read: artificial intelligence really hard
https://thegradient.pub/why-transformative-artificial-intelligence-is-really-really-hard-to-achieve/ Why transformative artificial intelligence is really, really hard to achieveArjun Ramani and Zhengdong Wang26.Jun.2023“1. The transformational potential of AI is constrained by its hardest problems