natural language processing – Page 18

What I Read: Knowledge Graphs with Language Model

By Andrew Fairless on June 16, 2021June 7, 2021

https://ai.googleblog.com/2021/05/kelm-integrating-knowledge-graphs-with.html KELM: Integrating Knowledge Graphs with Language Model Pre-training CorporaThursday, May 20, 2021Posted by Siamak Shakeri, Staff Software Engineer and Oshin Agarwal, Research Intern, Google Research “Alternate sources of informationContinue readingWhat I Read: Knowledge Graphs with Language Model

What I Read: Dataset Curation for NLP Projects

By Andrew Fairless on June 15, 2021May 30, 2021

https://www.kdnuggets.com/2021/05/4-tips-dataset-curation-nlp-projects.html 4 Tips for Dataset Curation for NLP ProjectsBy Paul Barba, Chief Scientist, Lexalytics. “After many years of painfully learned lessons from managing and implementing AI and ML projects, I’veContinue readingWhat I Read: Dataset Curation for NLP Projects

What I Read: Reducing Toxicity in Language Models

By Andrew Fairless on May 10, 2021April 17, 2021

https://lilianweng.github.io/lil-log/2021/03/21/reducing-toxicity-in-language-models.html Reducing Toxicity in Language Modelsby Lilian WengMar 21, 2021 “Large pretrained language models are trained over a sizable collection of online data. They unavoidably acquire certain toxic behavior andContinue readingWhat I Read: Reducing Toxicity in Language Models

What I Read: Zero-Shot Learning

By Andrew Fairless on May 6, 2021April 13, 2021

https://www.kdnuggets.com/2021/04/zero-shot-learning.html Zero-Shot Learning: Can you classify an object without seeing it before?Developing machine learning models that can perform predictive functions on data it has never seen before has become anContinue readingWhat I Read: Zero-Shot Learning

What I Read: Reducing High Cost of Training NLP Models

By Andrew Fairless on March 29, 2021April 3, 2021

https://www.asapp.com/blog/reducing-the-high-cost-of-training-nlp-models-with-sru/ Reducing the High Cost of Training NLP Models With SRU++By Tao Lei, PhDResearch Leader and Scientist at ASAPP “The Transformer architecture was proposed to accelerate model training in NLP….Continue readingWhat I Read: Reducing High Cost of Training NLP Models

What I Read: Language Model Fine-tuning

By Andrew Fairless on March 26, 2021March 7, 2021

https://ruder.io/recent-advances-lm-fine-tuning/ Recent Advances in Language Model Fine-tuningThis article provides an overview of recent methods to fine-tune large pre-trained language models.Sebastian Ruder24 Feb 2021 “While pre-training is compute-intensive, fine-tuning can beContinue readingWhat I Read: Language Model Fine-tuning

What I Read: Transformer Networks to Answer Questions About Images

By Andrew Fairless on March 13, 2021March 7, 2021

https://medium.com/dataseries/microsoft-uses-transformer-networks-to-answer-questions-about-images-with-minimum-training-f978c018bb72 Microsoft Uses Transformer Networks to Answer Questions About Images With Minimum TrainingUnified VLP can understand concepts about scenic images by using pretrained models.Jesus RodriguezJan 12 “Can we build deepContinue readingWhat I Read: Transformer Networks to Answer Questions About Images

What I Read: Neural Text Generation

By Andrew Fairless on March 11, 2021March 7, 2021

https://lilianweng.github.io/lil-log/2021/01/02/controllable-neural-text-generation.html Controllable Neural Text GenerationJan 2, 2021Lilian Weng “How to steer a powerful unconditioned language model? In this post, we will delve into several approaches for controlled content generation withContinue readingWhat I Read: Neural Text Generation

What I Read: Why I’m lukewarm on graph neural networks

By Andrew Fairless on March 10, 2021March 7, 2021

https://www.singlelunch.com/2020/12/28/why-im-lukewarm-on-graph-neural-networks/ Why I’m lukewarm on graph neural networksMatt RangerFebruary 16, 2020 “I’m only lukewarm on Graph Neural Networks (GNNs)…. I think some progress can come of this research, but we’reContinue readingWhat I Read: Why I’m lukewarm on graph neural networks

What I Read: How Transformers work

By Andrew Fairless on March 9, 2021March 7, 2021

https://theaisummer.com/transformer/ How Transformers work in deep learning and NLP: an intuitive introductionNatural Language ProcessingNikolas AdaloglouDec 24, 2020 “In my opinion, transformers are not so hard to grasp. It’s the combinationContinue readingWhat I Read: How Transformers work

Tag: natural language processing