https://lunar-joke-35b.notion.site/Transfer-Learning-101-133ba4b6a3fa800e8cede11ee3f1c1cd Transfer Learning 101Himanshu DubeyNov 5, 2024 “Let’s understand Transfer Learning in greater detail.”
What I Read: Transformers Training
https://www.borealisai.com/research-blogs/tutorial-17-transformers-iii-training/ Tutorial #17: Transformers III Training08/06/2021P. Xu, S. Prince “…we discuss challenges with transformer training dynamics and introduce some of the tricks that practitioners use to get transformers to converge.”