https://www.quantamagazine.org/will-transformers-take-over-artificial-intelligence-20220310/ Will Transformers Take Over Artificial Intelligence?A simple algorithm that revolutionized how neural networks approach language is now taking on vision as well. It may not stop there.Stephen OrnesContributing WriterMarch
What I Read: SwAV method
https://m0nads.wordpress.com/2021/01/08/the-swav-method/ The SwAV methodAntonio Ferraioli “The SwAV method is a clustering-based online method whose goal is to learn visual features in an online fashion without supervision.”
What I Read: CNN Heat Maps, Class Activation Mapping
https://glassboxmedicine.com/2019/06/11/cnn-heat-maps-class-activation-mapping-cam/ CNN Heat Maps: Class Activation Mapping (CAM)Date: June 11, 2019Author: Rachel Draelos “Class Activation Mapping (CAM) is one technique for producing heat maps to highlight class-specific regions of images.”
What I Read: Better computer vision models, Transformers, CNNs
https://ai.facebook.com/blog/computer-vision-combining-transformers-and-convolutional-neural-networks/ Better computer vision models by combining Transformers and convolutional neural networksJuly 8, 2021 “We’ve developed a new computer vision model… which combines… convolutional neural networks (CNNs) and Transformer-based models…
What I Read: Revisiting Sutton’s Bitter Lesson for AI
https://blog.exxactcorp.com/compute-goes-brrr-revisiting-suttons-bitter-lesson-artificial-intelligence/ Deep LearningCompute Goes Brrr: Revisiting Sutton’s Bitter Lesson for Artificial IntelligenceMarketing, October 27, 2020 “The main driver of AI progress, according to Sutton, is the increasing availability of compute
What I Read: Neural Networks Help Explain Brains
https://www.quantamagazine.org/deep-neural-networks-help-to-explain-living-brains-20201028/ neuroscienceDeep Neural Networks Help to Explain Living Brains Deep neural networks, often criticized as “black boxes,” are helping neuroscientists understand the organization of living brains.“If their CNN mimicked a