https://amitness.com/2020/05/self-supervised-learning-nlp/ Self Supervised Representation Learning in NLPPublished May 23, 2020 in nlp “While Computer Vision is making amazing progress on self-supervised learning only in the last few years, self-supervised learning
What I Read: Reformer efficient Transformer
https://towardsdatascience.com/illustrating-the-reformer-393575ac6ba0?gi=34b920510f6f Illustrating the ReformerThe efficient TransformerAlireza DirafzoonFeb 4 “Recently, Google introduced the Reformer architecture, a Transformer model designed to efficiently handle processing very long sequences of data (e.g. up to