What I Read: Transformers in computer vision

https://theaisummer.com/transformers-computer-vision/

Transformers in computer vision: ViT architectures, tips, tricks and improvements
Nikolas Adaloglouon
2021-10-21


“You are probably already aware of the Vision Transformer (ViT)…. We will address questions like how can you adapt/use ViT on your computer vision problem, what are the best ViT-based architectures, training tricks and recipes, scaling laws, supervised vs self-supervised pre-training, etc.”