https://eigenfoo.xyz/floating-point-deep-learning/
Floating-Point Formats and Deep Learning
“Floating-point format is not a crucial consideration in deep learning, but it can make a significant difference. What is floating-point, why should you (a deep learning practictioner) care, and what can you do about it?”