https://www.quantamagazine.org/new-algorithm-breaks-speed-limit-for-solving-linear-equations-20210308/ New Algorithm Breaks Speed Limit for Solving Linear EquationsKevin HartnettMarch 8, 2021 “By harnessing randomness, a new algorithm achieves a fundamentally novel — and faster — way of performing
What I Read: Attention with Performers
https://ai.googleblog.com/2020/10/rethinking-attention-with-performers.html Rethinking Attention with PerformersFriday, October 23, 2020Posted by Krzysztof Choromanski and Lucy Colwell, Research Scientists, Google Research “To resolve these issues, we introduce the Performer, a Transformer architecture with
What I Read: sub-linear deep learning algorithm
https://www.kdnuggets.com/2020/03/deep-learning-breakthrough-sub-linear-algorithm-no-gpu.html Deep Learning Breakthrough: a sub-linear deep learning algorithm that does not need a GPU?By Anshumali Shrivastava, Rice University. “Backpropagation is not an efficient algorithm…. The core idea behind the