training – Page 4 – Andrew Fairless, Ph.D.

What I Read: How Train Large Deep Learning Models

By Andrew Fairless on November 8, 2021October 24, 2021

https://www.assemblyai.com/blog/how-to-train-large-deep-learning-models-as-a-startup/ How to Train Large Deep Learning Models as a StartupDylan FoxOct 7, 2021Training large deep learning models is expensive and slow. Yet, startups are all about iterating fast. InContinue readingWhat I Read: How Train Large Deep Learning Models

What I Read: How to Train Really Large Models

By Andrew Fairless on October 26, 2021October 16, 2021

https://lilianweng.github.io/lil-log/2021/09/24/train-large-neural-networks.html How to Train Really Large Models on Many GPUs?Sep 24, 2021Lilian Weng “How to train large and deep neural networks is challenging, as it demands a large amount ofContinue readingWhat I Read: How to Train Really Large Models

What I Read: Continuous Training Strategy

By Andrew Fairless on May 12, 2021April 17, 2021

https://www.superwise.ai/resources/framework-for-a-successful-continuous-training-strategy Framework for a successful Continuous Training StrategyOr Itzary & Liran NahumMarch 18, 2021 “…ML models need to be retrained regularly…. Continuous training seeks to automatically and continuously retrain theContinue readingWhat I Read: Continuous Training Strategy

What I Read: Reproducing Deep Double Descent

By Andrew Fairless on February 7, 2021January 11, 2021

https://hippocampus-garden.com/double_descent/ Reproducing Deep Double DescentShion HondaJune 13, 2020 “…you’ve probably heard of bias-variance trade-off… But, do you know that there is a continuation of the U-shaped test risk curve? Surprisingly,Continue readingWhat I Read: Reproducing Deep Double Descent

What I Read: Deep Double Descent: Where Bigger Models and More Data Hurt

By Andrew Fairless on February 6, 2021January 11, 2021

https://arxiv.org/abs/1912.02292 Deep Double Descent: Where Bigger Models and More Data HurtPreetum Nakkiran, Gal Kaplun, Yamini Bansal, Tristan Yang, Boaz Barak, Ilya Sutskever “We show that a variety of modern deepContinue readingWhat I Read: Deep Double Descent: Where Bigger Models and More Data Hurt

What I Read: The Ultimate Guide to Model Retraining

By Andrew Fairless on November 29, 2020November 28, 2020

https://www.kdnuggets.com/2019/12/ultimate-guide-model-retraining.html The Ultimate Guide to Model RetrainingBy Luigi Patruno, Data Scientist and the founder of ML in Production. “…one of the most important things you can do before deploying aContinue readingWhat I Read: The Ultimate Guide to Model Retraining

Tag: training