deep learning – Andrew Fairless, Ph.D.

What I Read: Accelerating PyTorch

By Andrew Fairless on September 6, 2023August 1, 2023

https://magazine.sebastianraschka.com/p/accelerating-pytorch-model-training Accelerating PyTorch Model TrainingUsing Mixed-Precision and Fully Sharded Data ParallelismSebastian Raschka, PhDJun 26, 2023 “…how to scale PyTorch model training with minimal code changes. The focus here is onContinue readingWhat I Read: Accelerating PyTorch

What I Read: Aristotle, Deep Learning

By Andrew Fairless on March 17, 2022March 12, 2022

https://thegradient.pub/how-aristotle-is-fixing-deep-learnings-flaws/ How Aristotle is Fixing Deep Learning’s FlawsPaul J. Blazek17.Feb.2022 “…Aristotle’s logic still stands strong, poignantly describing the building blocks of human reasoning. Yet many of the key ingredients describedContinue readingWhat I Read: Aristotle, Deep Learning

What I Read: Same or Different? The Question Flummoxes Neural Networks

By Andrew Fairless on July 19, 2021July 2, 2021

https://www.quantamagazine.org/same-or-different-ai-cant-tell-20210623/ Same or Different? The Question Flummoxes Neural Networks.John PavlusContributing WriterJune 23, 2021 “One of the most powerful classes of artificial intelligence systems, known as convolutional neural networks or CNNs…Continue readingWhat I Read: Same or Different? The Question Flummoxes Neural Networks

What I Read: Tabular Data, Deep Learning is Not All You Need

By Andrew Fairless on July 14, 2021June 22, 2021

https://arxiv.org/abs/2106.03253v1 Tabular Data: Deep Learning is Not All You NeedRavid Shwartz-Ziv, Amitai Armon “Our study shows that XGBoost outperforms these deep models across the datasets, including datasets used in theContinue readingWhat I Read: Tabular Data, Deep Learning is Not All You Need

What I Read: Neural Nets, How Brains Learn

By Andrew Fairless on March 23, 2021March 7, 2021

https://www.quantamagazine.org/artificial-neural-nets-finally-yield-clues-to-how-brains-learn-20210218/ Artificial Neural Nets Finally Yield Clues to How Brains LearnAnil AnanthaswamyContributing WriterFebruary 18, 2021 “The learning algorithm that enables the runaway success of deep neural networks doesn’t work inContinue readingWhat I Read: Neural Nets, How Brains Learn

What I Read: Continual Learning, Amnesia, Neural Networks

By Andrew Fairless on March 22, 2021March 7, 2021

https://medium.com/dataseries/ibm-uses-continual-learning-to-avoid-the-amnesia-problem-in-neural-networks-ae8241e1f3a3 IBM Uses Continual Learning to Avoid The Amnesia Problem in Neural NetworksUsing continual learning might avoid the famous catastrophic forgetting problem in neural networks.Jesus RodriguezJan 25 “Building neural networksContinue readingWhat I Read: Continual Learning, Amnesia, Neural Networks

What I Read: Adversarial generation of extreme samples

By Andrew Fairless on March 19, 2021March 7, 2021

https://aihub.org/2020/10/01/adversarial-generation-of-extreme-samples/ Adversarial generation of extreme samplesby Lucy SmithOctober 1, 2020 “…existing GAN-based methods tend to generate typical samples.. the authors seek to design deep learning-based models that can generate samplesContinue readingWhat I Read: Adversarial generation of extreme samples

What I Read: Revisiting Sutton’s Bitter Lesson for AI

By Andrew Fairless on February 15, 2021January 18, 2021

https://blog.exxactcorp.com/compute-goes-brrr-revisiting-suttons-bitter-lesson-artificial-intelligence/ Deep LearningCompute Goes Brrr: Revisiting Sutton’s Bitter Lesson for Artificial IntelligenceMarketing, October 27, 2020 “The main driver of AI progress, according to Sutton, is the increasing availability of computeContinue readingWhat I Read: Revisiting Sutton’s Bitter Lesson for AI

What I Read: Frameworks Scaling Deep Learning Training

By Andrew Fairless on February 9, 2021January 12, 2021

https://medium.com/dataseries/microsoft-and-google-open-sourced-these-frameworks-based-on-their-work-scaling-deep-learning-c0510e907038 Microsoft and Google Open Sourced These Frameworks Based on Their Work Scaling Deep Learning TrainingGoogle and Microsoft have recently released new frameworks for distributed deep learning training.Jesus RodriguezOct 26Continue readingWhat I Read: Frameworks Scaling Deep Learning Training

What I Read: Neural Networks Help Explain Brains

By Andrew Fairless on February 1, 2021January 7, 2021

https://www.quantamagazine.org/deep-neural-networks-help-to-explain-living-brains-20201028/ neuroscienceDeep Neural Networks Help to Explain Living Brains Deep neural networks, often criticized as “black boxes,” are helping neuroscientists understand the organization of living brains.“If their CNN mimicked aContinue readingWhat I Read: Neural Networks Help Explain Brains

Tag: deep learning