https://www.quantamagazine.org/researchers-glimpse-how-ai-gets-so-good-at-language-processing-20220414/ Researchers Gain New Understanding From Simple AIMordechai RorvigStaff WriterApril 14, 2022 “Language processing programs are notoriously hard to interpret, but smaller versions can provide important insights into how they
What I Read: forecasting, quantile functions
https://www.amazon.science/blog/improving-forecasting-by-learning-quantile-functions Improving forecasting by learning quantile functionsBy Youngsuk Park, François-Xavier AubetMarch 31, 2022 “Learning the complete quantile function, which maps probabilities to variable values, rather than building separate models for
What I Read: Graph ML, missing node features
https://blog.twitter.com/engineering/en_us/topics/insights/2022/graph-machine-learning-with-missing-node-features Graph machine learning with missing node featuresEmanuele RossiMaria GorinovaThursday, 17 March 2022 “…GNNs typically run under the assumption of a full set of features available for all nodes. In
What I Read: Policy Regulariser, Adversary
https://deepmindsafetyresearch.medium.com/your-policy-regulariser-is-secretly-an-adversary-14684c743d45 Your Policy Regulariser is Secretly an AdversaryDeepMind Safety ResearchMar 24 By Rob Brekelmans, Tim Genewein, Jordi Grau-Moya, Grégoire Delétang, Markus Kunesch, Shane Legg, Pedro A. Ortega“Policy regularisation can be
What I Read: Generalization of SGD
https://www.quantamagazine.org/machine-learning-reimagines-the-building-blocks-of-computing-20220315/ Machine Learning Reimagines the Building Blocks of ComputingNick ThiemeContributing WriterMarch 15, 2022 “Traditional algorithms power complicated computational tools like machine learning. A new approach, called algorithms with predictions, uses
What I Read: Machine Learning, Building Blocks of Computing
https://www.quantamagazine.org/machine-learning-reimagines-the-building-blocks-of-computing-20220315/ Machine Learning Reimagines the Building Blocks of ComputingNick ThiemeContributing WriterMarch 15, 2022 “Traditional algorithms power complicated computational tools like machine learning. A new approach, called algorithms with predictions, uses
What I Read: Deep Learning From First Principles
https://horace.io/brrr_intro.html Making Deep Learning Go Brrrr From First PrinciplesHorace He “So, you want to improve the performance of your deep learning model. How might you approach such a task?”