https://lilianweng.github.io/lil-log/2021/09/24/train-large-neural-networks.html How to Train Really Large Models on Many GPUs?Sep 24, 2021Lilian Weng “How to train large and deep neural networks is challenging, as it demands a large amount of
What I Read: Deep Learning Recommendation Models
https://www.kdnuggets.com/2021/04/deep-learning-recommendation-models-dlrm-deep-dive.html Deep Learning Recommendation Models (DLRM): A Deep DiveBy Nishant Kumar, Data Science Professional. “This deep dive article presents the architecture and deployment issues experienced with the deep learning recommendation
What I Read: Brain ‘Rotates’ Memories to Save Them From New Sensations
https://www.quantamagazine.org/the-brain-rotates-memories-to-save-them-from-new-sensations-20210415/ The Brain ‘Rotates’ Memories to Save Them From New SensationsJordana CepelewiczStaff WriterApril 15, 2021 “Some populations of neurons simultaneously process sensations and memories. New work shows how the brain