https://huggingface.co/blog/clefourrier/llm-evaluation
Let’s talk about LLM evaluation
May 23, 2024
Clémentine Fourrier
“There are, to my knowledge, at the moment, 3 main ways to do evaluation: automated benchmarking, using humans as judges, and using models as judges. Each approach has its own reason for existing, uses, and limitations.”