What I Read: History, Transformer


Shaping the Future of AI from the History of Transformer
Stanford CS25: V4 I Hyung Won Chung of OpenAI
Stanford Online


“I will provide a highly-opinionated view on the early history of Transformer architectures, focusing on what motivated each development and how each became less relevant with more compute.”