https://towardsdatascience.com/building-a-tree-structured-parzen-estimator-from-scratch-kind-of-20ed31770478 Building a Tree-Structured Parzen Estimator from Scratch (Kind Of)An alternative to traditional hyperparameter tuning methodsColin HorganApr 4 “Although popular, Grid and Random Search methods… are purely trial and error.
What I Read: Optimizing Machine Learning Training Pipelines
https://medium.com/ntropy-network/bag-of-tricks-for-optimizing-machine-learning-training-pipelines-4f8d5cd3d432 Bag of tricks for optimizing machine learning training pipelinesArseny KravchenkoJan 5 “…we are constantly looking for ways to improve the efficiency of our machine learning pipelines, while keeping the
What I Read: Transformers Training
https://www.borealisai.com/research-blogs/tutorial-17-transformers-iii-training/ Tutorial #17: Transformers III Training08/06/2021P. Xu, S. Prince “…we discuss challenges with transformer training dynamics and introduce some of the tricks that practitioners use to get transformers to converge.”
What I Read: Machine Learning, Building Blocks of Computing
https://www.quantamagazine.org/machine-learning-reimagines-the-building-blocks-of-computing-20220315/ Machine Learning Reimagines the Building Blocks of ComputingNick ThiemeContributing WriterMarch 15, 2022 “Traditional algorithms power complicated computational tools like machine learning. A new approach, called algorithms with predictions, uses