https://willwhitney.com/parallel-training-jax.html Will WhitneyParallelizing neural networks on one GPU with JAX How you can get a 100x speedup for training small neural networks by making the most of your accelerator.“Most neural
What I Read: Better computer vision models, Transformers, CNNs
https://ai.facebook.com/blog/computer-vision-combining-transformers-and-convolutional-neural-networks/ Better computer vision models by combining Transformers and convolutional neural networksJuly 8, 2021 “We’ve developed a new computer vision model… which combines… convolutional neural networks (CNNs) and Transformer-based models…
What I Read: Do Wide and Deep Networks Learn the Same Things?
https://ai.googleblog.com/2021/05/do-wide-and-deep-networks-learn-same.html Do Wide and Deep Networks Learn the Same Things?Tuesday, May 4, 2021Posted by Thao Nguyen, AI Resident, Google Research
What I Read: Neural Nets Solve World’s Hardest Equations Faster
https://www.quantamagazine.org/new-neural-networks-solve-hardest-equations-faster-than-ever-20210419/ Latest Neural Nets Solve World’s Hardest Equations Faster Than Ever BeforeAnil AnanthaswamyContributing WriterApril 19, 2021 “Two new approaches allow deep neural networks to solve entire families of partial differential
What I Read: Adversarial Neural Cryptography
https://pub.towardsai.net/what-is-adversarial-neural-cryptography-70b461c7db88?gi=3bf97cbeefd What is Adversarial Neural Cryptography?The novel approach combines GANs and cryptography in a single, powerful security method.Jesus RodriguezApr 19 “Somewhere between anonymization methods and homomorphic encryption, we find a