transformer – Page 8 – Andrew Fairless, Ph.D.

What I Read: Language Model Fine-tuning

By Andrew Fairless on March 26, 2021March 7, 2021

https://ruder.io/recent-advances-lm-fine-tuning/ Recent Advances in Language Model Fine-tuningThis article provides an overview of recent methods to fine-tune large pre-trained language models.Sebastian Ruder24 Feb 2021 “While pre-training is compute-intensive, fine-tuning can beContinue readingWhat I Read: Language Model Fine-tuning

What I Read: Transformer Networks to Answer Questions About Images

By Andrew Fairless on March 13, 2021March 7, 2021

https://medium.com/dataseries/microsoft-uses-transformer-networks-to-answer-questions-about-images-with-minimum-training-f978c018bb72 Microsoft Uses Transformer Networks to Answer Questions About Images With Minimum TrainingUnified VLP can understand concepts about scenic images by using pretrained models.Jesus RodriguezJan 12 “Can we build deepContinue readingWhat I Read: Transformer Networks to Answer Questions About Images

What I Read: Neural Text Generation

By Andrew Fairless on March 11, 2021March 7, 2021

https://lilianweng.github.io/lil-log/2021/01/02/controllable-neural-text-generation.html Controllable Neural Text GenerationJan 2, 2021Lilian Weng “How to steer a powerful unconditioned language model? In this post, we will delve into several approaches for controlled content generation withContinue readingWhat I Read: Neural Text Generation

What I Read: Why I’m lukewarm on graph neural networks

By Andrew Fairless on March 10, 2021March 7, 2021

https://www.singlelunch.com/2020/12/28/why-im-lukewarm-on-graph-neural-networks/ Why I’m lukewarm on graph neural networksMatt RangerFebruary 16, 2020 “I’m only lukewarm on Graph Neural Networks (GNNs)…. I think some progress can come of this research, but we’reContinue readingWhat I Read: Why I’m lukewarm on graph neural networks

What I Read: How Transformers work

By Andrew Fairless on March 9, 2021March 7, 2021

https://theaisummer.com/transformer/ How Transformers work in deep learning and NLP: an intuitive introductionNatural Language ProcessingNikolas AdaloglouDec 24, 2020 “In my opinion, transformers are not so hard to grasp. It’s the combinationContinue readingWhat I Read: How Transformers work

What I Read: Data-efficient image Transformers

By Andrew Fairless on March 5, 2021March 5, 2021

Data-efficient image Transformers: A promising new technique for image classificationDecember 23, 2020 “We’ve developed a new method to train computer vision models that leverage Transformers…. Our new technique — Data-efficientContinue readingWhat I Read: Data-efficient image Transformers

What I Read: Introduction to Graph Neural Networks

By Andrew Fairless on February 23, 2021April 3, 2021

https://blog.exxactcorp.com/a-friendly-introduction-to-graph-neural-networks/ Deep LearningA Friendly Introduction to Graph Neural NetworksMarketing, November 11, 2020 “Graph neural networks (GNNs) belong to a category of neural networks that operate naturally on data structured asContinue readingWhat I Read: Introduction to Graph Neural Networks

What I Read: HuggingFace Transformers

By Andrew Fairless on February 18, 2021January 18, 2021

https://medium.com/georgian-impact-blog/how-to-incorporate-tabular-data-with-huggingface-transformers-b70ac45fcfb4 How to Incorporate Tabular Data with HuggingFace TransformersGeorgianOct 23 “At Georgian, we find ourselves working with supporting tabular feature information as well as unstructured text data. We found thatContinue readingWhat I Read: HuggingFace Transformers

What I Read: Revisiting Sutton’s Bitter Lesson for AI

By Andrew Fairless on February 15, 2021January 18, 2021

https://blog.exxactcorp.com/compute-goes-brrr-revisiting-suttons-bitter-lesson-artificial-intelligence/ Deep LearningCompute Goes Brrr: Revisiting Sutton’s Bitter Lesson for Artificial IntelligenceMarketing, October 27, 2020 “The main driver of AI progress, according to Sutton, is the increasing availability of computeContinue readingWhat I Read: Revisiting Sutton’s Bitter Lesson for AI

What I Read: Attention with Performers

By Andrew Fairless on February 7, 2021January 11, 2021

https://ai.googleblog.com/2020/10/rethinking-attention-with-performers.html Rethinking Attention with PerformersFriday, October 23, 2020Posted by Krzysztof Choromanski and Lucy Colwell, Research Scientists, Google Research “To resolve these issues, we introduce the Performer, a Transformer architecture withContinue readingWhat I Read: Attention with Performers

Tag: transformer