https://www.sh-reya.com/blog/ai-engineering-flywheel
Data Flywheels for LLM Applications
Shreya Shankar
Jul 1, 2024
“This diagram illustrates my (idealized) architecture of an LLM pipeline, from input processing through evaluation and logging. It showcases ideas I’ll discuss throughout the blog post, such as input validation, dynamic few-shot example retrieval, and the use of both code-based and LLM-based metrics for evaluation.”