attention – Page 3 – Andrew Fairless, Ph.D.

What I Read: LLMs

By Andrew Fairless on September 7, 2023August 1, 2023

https://willthompson.name/what-we-know-about-llms-primer What We Know About LLMs (Primer)Will Thompson (Twitter)July 23, 2023 “…it is worth reflecting on what we concretely know about LLMs at this point in time and how theseContinue readingWhat I Read: LLMs

What I Read: What, Why ChatGPT

By Andrew Fairless on July 12, 2023June 15, 2023

https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/ What Is ChatGPT Doing … and Why Does It Work?February 14, 2023Stephen Wolfram “That ChatGPT can automatically generate something that reads even superficially like human-written text is remarkable, andContinue readingWhat I Read: What, Why ChatGPT

What I Read: Geometric Deep Learning

By Andrew Fairless on April 10, 2023February 22, 2023

https://thegradient.pub/towards-geometric-deep-learning/ Towards Geometric Deep LearningMichael Bronstein18.Feb.2023 “Geometric Deep Learning is an umbrella term for approaches considering a broad class of ML problems from the perspectives of symmetry and invariance.”

What I Read: Transformers, Brain

By Andrew Fairless on November 9, 2022September 27, 2022

https://www.quantamagazine.org/how-ai-transformers-mimic-parts-of-the-brain-20220912/ How Transformers Seem to Mimic Parts of the BrainStephen OrnesSeptember 12, 2022 “Neural networks originally designed for language processing turn out to be great models of how our brainsContinue readingWhat I Read: Transformers, Brain

What I Read: Causal Inference

By Andrew Fairless on October 25, 2022September 9, 2022

https://thegradient.pub/causal-inference-connecting-data-and-reality/ Causal Inference: Connecting Data and RealityWenwen Ding04.Sep.2022 “Causal inference is a theory that describes, discriminates, and measures causal relationships, developed from statistics.”

What I Read: Zero-Shot, K-Shot Learning

By Andrew Fairless on October 18, 2022September 9, 2022

https://www.datature.io/blog/zero-shot-and-k-shot-learning Comprehensive Guide to Zero-Shot and K-Shot LearningLeonard SoAugust 23, 2022 “Few-shot learning is a type of supervised learning that is intended to rapidly generalise to new tasks containing onlyContinue readingWhat I Read: Zero-Shot, K-Shot Learning

What I Read: Emergent Features

By Andrew Fairless on October 6, 2022August 22, 2022

LLM.int8() and Emergent Features LLM.int8() and Emergent Features2022-08-17 by Tim Dettmers “…I use advanced quantization methods to achieve no performance degradation transformer inference at scale that makes large models moreContinue readingWhat I Read: Emergent Features

What I Read: Transformers in computer vision

By Andrew Fairless on September 6, 2022August 3, 2022

https://theaisummer.com/transformers-computer-vision/ Transformers in computer vision: ViT architectures, tips, tricks and improvementsNikolas Adaloglouon2021-10-21 “You are probably already aware of the Vision Transformer (ViT)…. We will address questions like how can youContinue readingWhat I Read: Transformers in computer vision

What I Read: Beyond Message Passing, Graph Neural Networks

By Andrew Fairless on June 6, 2022May 23, 2022

https://thegradient.pub/graph-neural-networks-beyond-message-passing-and-weisfeiler-lehman/ Beyond Message Passing: a Physics-Inspired Paradigm for Graph Neural NetworksMichael Bronstein07.May.2022 “…the “node and edge-centric” mindset of current graph deep learning schemes imposes strong limitations… we propose physics-inspired “continuous”Continue readingWhat I Read: Beyond Message Passing, Graph Neural Networks

What I Read: Will Transformers Take Over Artificial Intelligence?

By Andrew Fairless on April 26, 2022March 12, 2022

https://www.quantamagazine.org/will-transformers-take-over-artificial-intelligence-20220310/ Will Transformers Take Over Artificial Intelligence?A simple algorithm that revolutionized how neural networks approach language is now taking on vision as well. It may not stop there.Stephen OrnesContributing WriterMarchContinue readingWhat I Read: Will Transformers Take Over Artificial Intelligence?

Tag: attention