https://alexshtf.github.io/2024/07/07/HadamardParameterization.html Alex ShtoffFun with sparsity in PyTorch via Hadamard product parametrizationJul 7, 2024 “The beauty of sparsity inducing regularization is that we let our optimizer discover the sparsity patterns, instead
What I Read: Engineering Trade-Offs in Automatic Differentiation
https://www.stochasticlifestyle.com/engineering-trade-offs-in-automatic-differentiation-from-tensorflow-and-pytorch-to-jax-and-julia/ Engineering Trade-Offs in Automatic Differentiation: from TensorFlow and PyTorch to Jax and JuliaDecember 25 2021Author: Christopher Rackauckas “To understand the differences between automatic differentiation libraries, let’s talk about the
What I Read: Tonks Multi-Task Model
https://medium.com/shoprunner/tonks-building-one-multi-task-model-to-rule-them-all-3e5d020f1f2b Tonks: Building One (Multi-Task) Model to Rule Them All!Co-written by Nicole Carlson and Michael SugimuraMichael SugimuraApr 28 “Tonks is a library that streamlines the training of multi-task PyTorch networks.