transfer learning – Page 2 – Andrew Fairless, Ph.D.

What I Read: Continual Learning, Amnesia, Neural Networks

By Andrew Fairless on March 22, 2021March 7, 2021

https://medium.com/dataseries/ibm-uses-continual-learning-to-avoid-the-amnesia-problem-in-neural-networks-ae8241e1f3a3 IBM Uses Continual Learning to Avoid The Amnesia Problem in Neural NetworksUsing continual learning might avoid the famous catastrophic forgetting problem in neural networks.Jesus RodriguezJan 25 “Building neural networksContinue readingWhat I Read: Continual Learning, Amnesia, Neural Networks

What I Read: Can a neural network train other networks?

By Andrew Fairless on January 31, 2021January 6, 2021

https://towardsdatascience.com/can-a-neural-network-train-other-networks-cf371be516c6?gi=4765ee11be44 Can a neural network train other networks?An introduction to knowledge distillationTivadar DankaOct 5 “Now you have a huge model, which, although performs excellently, there is no way to deployContinue readingWhat I Read: Can a neural network train other networks?

What I Read: Production with Deep Semi-Supervised Learning

By Andrew Fairless on January 28, 2021January 2, 2021

https://towardsdatascience.com/from-research-to-production-with-deep-semi-supervised-learning-7caaedc39093 From Research to Production with Deep Semi-Supervised LearningVarun NairSep 25 “Semi-supervised learning (SSL), a subfield that combines both supervised and unsupervised learning, has grown in popularity in the deepContinue readingWhat I Read: Production with Deep Semi-Supervised Learning

What I Read: Continual Learning… and the Bridge to Active and Open World Learning

By Andrew Fairless on January 22, 2021December 30, 2020

https://arxiv.org/abs/2009.01797 A Wholistic View of Continual Learning with Deep Neural Networks: Forgotten Lessons and the Bridge to Active and Open World LearningMartin Mundt, Yong Won Hong, Iuliia Pliushch, Visvanathan RameshContinue readingWhat I Read: Continual Learning… and the Bridge to Active and Open World Learning

What I Read: Progress of Natural Language Processing

By Andrew Fairless on January 5, 2021December 22, 2020

https://blog.exxactcorp.com/the-unreasonable-progress-of-deep-neural-networks-in-natural-language-processing-nlp/ Deep LearningThe Unreasonable Progress of Deep Neural Networks in Natural Language Processing (NLP)Marketing, June 2, 2020 0 14 min read “With the advent of pre-trained generalized language models, weContinue readingWhat I Read: Progress of Natural Language Processing

What I Read: GPT-3, The New Mighty Language Model

By Andrew Fairless on December 28, 2020December 20, 2020

https://towardsdatascience.com/gpt-3-the-new-mighty-language-model-from-openai-a74ff35346fc?gi=a6255cca8370 GPT-3: The New Mighty Language Model from OpenAIPushing Deep Learning to the Limit with 175B ParametersMoiz SaifeeMay 31 “While this type of transfer learning obviates the need to useContinue readingWhat I Read: GPT-3, The New Mighty Language Model

Tag: transfer learning