https://magazine.sebastianraschka.com/p/new-llm-pre-training-and-post-training
New LLM Pre-training and Post-training Paradigms
A Look at How Modern LLMs Are Trained
Sebastian Raschka, PhD
Aug 17, 2024
“Initially, the LLM training process focused solely on pre-training, but it has since expanded to include both pre-training and post-training. Post-training typically encompasses supervised instruction fine-tuning and alignment…”