transformer – Page 7 – Andrew Fairless, Ph.D.

What I Read: Permutation-Invariant Neural Networks for Reinforcement Learning

By Andrew Fairless on October 5, 2021September 21, 2021

https://arxiv.org/abs/2109.02869v1 The Sensory Neuron as a Transformer: Permutation-Invariant Neural Networks for Reinforcement LearningYujin Tang, David Ha “…we build systems that feed each sensory input from the environment into distinct, butContinue readingWhat I Read: Permutation-Invariant Neural Networks for Reinforcement Learning

What I Read: Systems for Machine Learning

By Andrew Fairless on September 14, 2021August 20, 2021

https://thegradient.pub/systems-for-machine-learning/ Systems for Machine LearningKabir Nagrecha14.Aug.2021 “Machine learning’s increasing importance to real-world applications brought awareness of a new field focused on ML in practice – machine learning systems (or, asContinue readingWhat I Read: Systems for Machine Learning

What I Read: Advances in TF-Ranking

By Andrew Fairless on August 31, 2021August 17, 2021

https://ai.googleblog.com/2021/07/advances-in-tf-ranking.html Advances in TF-RankingTuesday, July 27, 2021 Posted by Michael Bendersky and Xuanhui Wang, Software Engineers, Google Research“LTR models — unlike standard classification models that classify one item at aContinue readingWhat I Read: Advances in TF-Ranking

What I Read: Geometric, Deep Learning

By Andrew Fairless on August 16, 2021July 22, 2021

https://towardsdatascience.com/geometric-foundations-of-deep-learning-94cdd45b451d?gi=d7fa7307aa63 Geometric foundations of Deep LearningGeometric Deep Learning is an attempt for geometric unification of a broad class of ML problems from the perspectives of symmetry and invariance. These principlesContinue readingWhat I Read: Geometric, Deep Learning

What I Read: Prompting, Language Models, NLP

By Andrew Fairless on August 9, 2021July 22, 2021

https://thegradient.pub/prompting/ Prompting: Better Ways of Using Language Models for NLP Tasks03.Jul.2021Tianyu Gao “The giant model size of GPT-3 is an important factor for its success, while the concept of promptsContinue readingWhat I Read: Prompting, Language Models, NLP

What I Read: Better computer vision models, Transformers, CNNs

By Andrew Fairless on July 27, 2021July 12, 2021

https://ai.facebook.com/blog/computer-vision-combining-transformers-and-convolutional-neural-networks/ Better computer vision models by combining Transformers and convolutional neural networksJuly 8, 2021 “We’ve developed a new computer vision model… which combines… convolutional neural networks (CNNs) and Transformer-based models…Continue readingWhat I Read: Better computer vision models, Transformers, CNNs

What I Read: Semantic Search

By Andrew Fairless on July 20, 2021July 2, 2021

https://www.pinecone.io/learn/semantic-search/ Semantic Search: Measuring Meaning From Jaccard to BertJames BriggsData Scientist “Similarity search is a complex topic and there are countless techniques for building effective search engines. In this article,Continue readingWhat I Read: Semantic Search

What I Read: Contrastive Representation Learning

By Andrew Fairless on July 1, 2021June 7, 2021

https://lilianweng.github.io/lil-log/2021/05/31/contrastive-representation-learning.html Contrastive Representation Learningby Lilian WengMay 31, 2021 “The goal of contrastive representation learning is to learn such an embedding space in which similar sample pairs stay close to eachContinue readingWhat I Read: Contrastive Representation Learning

What I Read: Reducing High Cost of Training NLP Models

By Andrew Fairless on March 29, 2021April 3, 2021

https://www.asapp.com/blog/reducing-the-high-cost-of-training-nlp-models-with-sru/ Reducing the High Cost of Training NLP Models With SRU++By Tao Lei, PhDResearch Leader and Scientist at ASAPP “The Transformer architecture was proposed to accelerate model training in NLP….Continue readingWhat I Read: Reducing High Cost of Training NLP Models

What I Read: Language Model Fine-tuning

By Andrew Fairless on March 26, 2021March 7, 2021

https://ruder.io/recent-advances-lm-fine-tuning/ Recent Advances in Language Model Fine-tuningThis article provides an overview of recent methods to fine-tune large pre-trained language models.Sebastian Ruder24 Feb 2021 “While pre-training is compute-intensive, fine-tuning can beContinue readingWhat I Read: Language Model Fine-tuning

Tag: transformer