What I Read: Better computer vision models, Transformers, CNNs

https://ai.facebook.com/blog/computer-vision-combining-transformers-and-convolutional-neural-networks/

Better computer vision models by combining Transformers and convolutional neural networks
July 8, 2021


“We’ve developed a new computer vision model… which combines… convolutional neural networks (CNNs) and Transformer-based models… By leveraging both techniques, this vision Transformer-based model can outperform existing architectures, especially in the low data regime, while achieving similar performance in the large data setting.”