matrix – Page 2 – Andrew Fairless, Ph.D.

What I Read: To Understand Transformers, Focus on Attention

By Andrew Fairless on October 16, 2023September 4, 2023

https://drscotthawley.github.io/blog/posts/Transformers1-Attention.html To Understand Transformers, Focus on AttentionScott H. HawleyAugust 21, 2023 “To Understand Transformers, Focus on Attention”

What I Read: speed up Numba and NumPy

By Andrew Fairless on August 1, 2023June 15, 2023

https://pythonspeed.com/articles/speeding-up-numba/ Understanding CPUs can help speed up Numba and NumPy codeby Itamar Turner-TrauringLast updated 08 Jun 2023, originally created 07 Jun 2023 “In practice, your initial Numba code may beContinue readingWhat I Read: speed up Numba and NumPy

What I Read: What, Why ChatGPT

By Andrew Fairless on July 12, 2023June 15, 2023

https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/ What Is ChatGPT Doing … and Why Does It Work?February 14, 2023Stephen Wolfram “That ChatGPT can automatically generate something that reads even superficially like human-written text is remarkable, andContinue readingWhat I Read: What, Why ChatGPT

What I Read: Computation, Artificial Intelligence

By Andrew Fairless on June 20, 2023May 1, 2023

https://www.quantamagazine.org/a-new-approach-to-computation-reimagines-artificial-intelligence-20230413/ A New Approach to Computation Reimagines Artificial IntelligenceAnil AnanthaswamyApril 13, 2023 “By imbuing enormous vectors with semantic meaning, we can get machines to reason more abstractly — and efficientlyContinue readingWhat I Read: Computation, Artificial Intelligence

What I Read: Open Source, AlphaTensor

By Andrew Fairless on June 13, 2023May 1, 2023

https://www.kdnuggets.com/2023/03/first-open-source-implementation-deepmind-alphatensor.html First Open Source Implementation of DeepMind’s AlphaTensorDiego Fiori, Co-founder & CTO at NebulyMarch 10, 2023 “The first open-source implementation of AlphaTensor has been released and opens the door forContinue readingWhat I Read: Open Source, AlphaTensor

What I Read: Sins, Numerical Linear Algebra

By Andrew Fairless on December 7, 2022October 20, 2022

https://nhigham.com/2022/10/11/seven-sins-of-numerical-linear-algebra/ Seven Sins of Numerical Linear AlgebraNick HighamPosted on October 11, 2022 by Nick Higham “In numerical linear algebra we are concerned with solving linear algebra problems accurately and efficientlyContinue readingWhat I Read: Sins, Numerical Linear Algebra

What I Read: Neural Tangent Kernel

By Andrew Fairless on November 2, 2022September 27, 2022

https://lilianweng.github.io/posts/2022-09-08-ntk/ Some Math behind Neural Tangent KernelLilian WengSeptember 8, 2022 “Neural tangent kernel… leads to great insights into why neural networks with enough width can consistently converge to a globalContinue readingWhat I Read: Neural Tangent Kernel

What I Read: AI Researcher, Bitter Medicine

By Andrew Fairless on October 20, 2022September 9, 2022

https://www.quantamagazine.org/the-ai-researcher-giving-her-field-its-bitter-medicine-20220830/ The AI Researcher Giving Her Field Its Bitter MedicineMax G. LevyAugust 30, 2022 “In practice, matrix methods in machine learning can’t effectively capture higher-order relationships. Essentially, you can’t learnContinue readingWhat I Read: AI Researcher, Bitter Medicine

What I Read: Einstein Summation in Deep Learning

By Andrew Fairless on January 26, 2022December 11, 2021

https://rockt.github.io/2018/04/30/einsum Einsum is All you Need – Einstein Summation in Deep LearningTim Rocktäschel30/04/2018 – updated 02/05/2018 “If you are anything like me, you find it difficult to remember the namesContinue readingWhat I Read: Einstein Summation in Deep Learning

Tag: matrix