https://theaisummer.com/transformers-computer-vision/
Transformers in computer vision: ViT architectures, tips, tricks and improvements
Nikolas Adaloglouon
2021-10-21
“You are probably already aware of the Vision Transformer (ViT)…. We will address questions like how can you adapt/use ViT on your computer vision problem, what are the best ViT-based architectures, training tricks and recipes, scaling laws, supervised vs self-supervised pre-training, etc.”