What I Read: memorization, novelty

https://blog.kjamistan.com/how-memorization-happens-novelty.html

How memorization happens: Novelty
09 Dezember 2024


“…repeated text and images incentivize training data memorization, but that’s not the only training data that machine learning models memorize. Let’s take a look at another proven memorization: novel examples.”