https://sakana.ai/transformer-squared
Transformer²: Self-Adaptive LLMs
sakana.ai
January 15, 2025
“Imagine a machine learning system that could adjust its own weights dynamically to thrive in unfamiliar settings, essentially illustrating a system that evolves as it learns. Self-adaptiveness in AI promises greater efficiency and the potential for lifelong models ever aligned with the dynamic nature of the real world.”