https://www.fast.ai/posts/2023-09-04-learning-jumps/
Can LLMs learn from a single example?
Jeremy Howard and Jonathan Whitaker
September 4, 2023
“We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug, but now we think it shows LLMs can learn effectively from a single example.”