https://maharshi.bearblog.dev/optimizing-softmax-cuda
Learning CUDA by optimizing softmax: A worklog
Maharshi Pandya
04 Jan, 2025
“Optimizing softmax, especially in the context of GPU programming with CUDA, presents many opportunities for learning.”