backpropagation – Andrew Fairless, Ph.D.

What I Read: Backpropagation, Chain Rule

By Andrew Fairless on October 13, 2022September 9, 2022

Backpropagation ≠ Chain Rule Backpropagation ≠ Chain RulePosted on December 16, 2021by Lunjia Hu “…a common belief that “backpropagation is just applying the chain rule repeatedly”. While this is in aContinue readingWhat I Read: Backpropagation, Chain Rule

What I Read: AI Researchers Fight Noise by Turning to Biology

By Andrew Fairless on February 1, 2022December 12, 2021

https://www.quantamagazine.org/ai-researchers-fight-noise-by-turning-to-biology-20211207/ AI Researchers Fight Noise by Turning to BiologyAllison WhittenContributing WriterDecember 7, 2021 “Tiny amounts of artificial noise can fool neural networks, but not humans. Some researchers are looking toContinue readingWhat I Read: AI Researchers Fight Noise by Turning to Biology

What I Read: Neuron Bursts Can Mimic Famous AI Learning Strategy

By Andrew Fairless on November 1, 2021October 24, 2021

https://www.quantamagazine.org/brain-bursts-can-mimic-famous-ai-learning-strategy-20211018/ Neuron Bursts Can Mimic Famous AI Learning StrategyAllison WhittenOctober 18, 2021“A new model of learning centers on bursts of neural activity that act as teaching signals — approximating backpropagation,Continue readingWhat I Read: Neuron Bursts Can Mimic Famous AI Learning Strategy

What I Read: sub-linear deep learning algorithm

By Andrew Fairless on December 19, 2020December 4, 2020

https://www.kdnuggets.com/2020/03/deep-learning-breakthrough-sub-linear-algorithm-no-gpu.html Deep Learning Breakthrough: a sub-linear deep learning algorithm that does not need a GPU?By Anshumali Shrivastava, Rice University. “Backpropagation is not an efficient algorithm…. The core idea behind theContinue readingWhat I Read: sub-linear deep learning algorithm

Tag: backpropagation