https://blog.kjamistan.com/how-memorization-happens-novelty.html
How memorization happens: Novelty
09 Dezember 2024
“…repeated text and images incentivize training data memorization, but that’s not the only training data that machine learning models memorize. Let’s take a look at another proven memorization: novel examples.”