https://pair.withgoogle.com/explorables/grokking/
Do Machine Learning Models Memorize or Generalize?
By Adam Pearce, Asma Ghandeharioun, Nada Hussein, Nithum Thain, Martin Wattenberg and Lucas Dixon
August 2023
“Large language models can certainly seem like they have a rich understanding of the world… How can we tell if they’re generalizing or memorizing?”