What I Read: Mystery of Deep Learning

https://www.quantamagazine.org/a-new-link-to-an-old-model-could-crack-the-mystery-of-deep-learning-20211011/

A New Link to an Old Model Could Crack the Mystery of Deep Learning
To help them explain the shocking success of deep neural networks, researchers are turning to older but better-understood models of machine learning.
Anil Ananthaswamy
Contributing Writer
October 11, 2021


“…idealized versions of these powerful networks are mathematically equivalent to older, simpler machine learning models called kernel machines. If this equivalence can be extended beyond idealized neural networks, it may explain how practical ANNs achieve their astonishing results.”