https://www.thonking.ai/p/what-shapes-do-matrix-multiplications
What Shapes Do Matrix Multiplications Like?
Horace He
Apr 01, 2024
“It has become tribal knowledge that the particular shapes chosen for matmuls has a surprisingly large effect on their performance. But … why? Can this be understood by mere mortals?”