https://magazine.sebastianraschka.com/p/accelerating-pytorch-model-training
Accelerating PyTorch Model Training
Using Mixed-Precision and Fully Sharded Data Parallelism
Sebastian Raschka, PhD
Jun 26, 2023
“…how to scale PyTorch model training with minimal code changes. The focus here is on leveraging mixed-precision techniques and multi-GPU training paradigms…”