What I Read: Progress of Natural Language Processing

https://blog.exxactcorp.com/the-unreasonable-progress-of-deep-neural-networks-in-natural-language-processing-nlp/

Deep Learning
The Unreasonable Progress of Deep Neural Networks in Natural Language Processing (NLP)
Marketing, June 2, 2020 0 14 min read


“With the advent of pre-trained generalized language models, we now have methods for transfer learning to new tasks with massive pre-trained models like GPT-2, BERT, and ELMO. These and similar models are doing real work in the world, both as a matter of everyday course (translation, transcription, etc.), and discovery at the frontiers of scientific knowledge…”