https://twiecki.io/blog/2024/01/04/
An Intuitive Guide to Self-Attention in GPT: The Venetian Masquerade
Thomas Wiecki
January 4, 2024
“In AI, especially with something as intricate as self-attention, it’s easy to get lost in the mathematical weeds, leaving the uninitiated bewildered by a sea of equations and terms like “queries,” “keys,” and “values.””