https://magazine.sebastianraschka.com/p/llm-training-rlhf-and-its-alternatives
LLM Training: RLHF and Its Alternatives
Sebastian Raschka, PhD
Sep 10, 2023
“RLHF is an integral part of the modern LLM training pipeline due to its ability to incorporate human preferences into the optimization landscape, which can improve the model’s helpfulness and safety.”