https://huyenchip.com//2024/01/16/sampling.html
Sampling for Text Generation
Chip Huyen
1/15/24
“ML models are probabilistic…. This probabilistic nature makes AI great for creative tasks…. However, this probabilistic nature also causes inconsistency and hallucinations. It’s fatal for tasks that depend on factuality.”