neural network – Page 11 – Andrew Fairless, Ph.D.

What I Read: Transformers, Brain

By Andrew Fairless on November 9, 2022September 27, 2022

https://www.quantamagazine.org/how-ai-transformers-mimic-parts-of-the-brain-20220912/ How Transformers Seem to Mimic Parts of the BrainStephen OrnesSeptember 12, 2022 “Neural networks originally designed for language processing turn out to be great models of how our brainsContinue readingWhat I Read: Transformers, Brain

What I Read: Neural Tangent Kernel

By Andrew Fairless on November 2, 2022September 27, 2022

https://lilianweng.github.io/posts/2022-09-08-ntk/ Some Math behind Neural Tangent KernelLilian WengSeptember 8, 2022 “Neural tangent kernel… leads to great insights into why neural networks with enough width can consistently converge to a globalContinue readingWhat I Read: Neural Tangent Kernel

What I Read: Zero-Shot, K-Shot Learning

By Andrew Fairless on October 18, 2022September 9, 2022

https://www.datature.io/blog/zero-shot-and-k-shot-learning Comprehensive Guide to Zero-Shot and K-Shot LearningLeonard SoAugust 23, 2022 “Few-shot learning is a type of supervised learning that is intended to rapidly generalise to new tasks containing onlyContinue readingWhat I Read: Zero-Shot, K-Shot Learning

What I Read: Backpropagation, Chain Rule

By Andrew Fairless on October 13, 2022September 9, 2022

Backpropagation ≠ Chain Rule Backpropagation ≠ Chain RulePosted on December 16, 2021by Lunjia Hu “…a common belief that “backpropagation is just applying the chain rule repeatedly”. While this is in aContinue readingWhat I Read: Backpropagation, Chain Rule

What I Read: AI, Limits, Language

By Andrew Fairless on October 12, 2022September 9, 2022

https://www.noemamag.com/ai-and-the-limits-of-language/AI And The Limits Of LanguageBy Jacob Browning and Yann LeCunAugust 23, 2022 “An artificial intelligence system trained on words and sentences alone will never approximate human understanding.”

What I Read: Emergent Features

By Andrew Fairless on October 6, 2022August 22, 2022

LLM.int8() and Emergent Features LLM.int8() and Emergent Features2022-08-17 by Tim Dettmers “…I use advanced quantization methods to achieve no performance degradation transformer inference at scale that makes large models moreContinue readingWhat I Read: Emergent Features

What I Read: Self-Taught AI, Brain

By Andrew Fairless on October 4, 2022August 22, 2022

https://www.quantamagazine.org/self-taught-ai-shows-similarities-to-how-the-brain-works-20220811/ Self-Taught AI Shows Similarities to How the Brain WorksAnil AnanthaswamyContributing WriterAugust 11, 2022 “Self-supervised learning allows a neural network to figure out for itself what matters. The process mightContinue readingWhat I Read: Self-Taught AI, Brain

What I Read: Challenging AI to Learn Better

By Andrew Fairless on September 20, 2022August 22, 2022

https://www.quantamagazine.org/the-computer-scientist-trying-to-teach-ai-to-learn-like-we-do-20220802/ The Computer Scientist Challenging AI to Learn BetterAllison WhittenContributing WriterAugust 2, 2022Christopher Kanan is building algorithms that can continuously learn over time — the way we do. “Instead ofContinue readingWhat I Read: Challenging AI to Learn Better

What I Read: BLOOM Training

By Andrew Fairless on September 12, 2022August 3, 2022

https://huggingface.co/blog/bloom-megatron-deepspeed The Technology Behind BLOOM TrainingStas BekmanPublished July 14, 2022. “…training ever larger language models has become the norm… the hidden knowledge about how to train such models rarely getsContinue readingWhat I Read: BLOOM Training

What I Read: Transformers in computer vision

By Andrew Fairless on September 6, 2022August 3, 2022

https://theaisummer.com/transformers-computer-vision/ Transformers in computer vision: ViT architectures, tips, tricks and improvementsNikolas Adaloglouon2021-10-21 “You are probably already aware of the Vision Transformer (ViT)…. We will address questions like how can youContinue readingWhat I Read: Transformers in computer vision

Tag: neural network