fine tuning – Andrew Fairless, Ph.D.

What I Read: evaluation quicksand

By Andrew Fairless on February 12, 2025October 25, 2024

https://www.interconnects.ai/p/building-on-evaluation-quicksand Building on evaluation quicksandNathan LambertOct 16, 2024 “In my article on “Big Tech’s LLM evals are just marketing,” I didn’t uncover the deeper reasons as to why can’t fullyContinue readingWhat I Read: evaluation quicksand

What I Watch: GenAI, Classify Text

By Andrew Fairless on January 21, 2025September 29, 2024

https://www.youtube.com/watch?v=Y4HQQPfyzwo Is GenAI All You Need to Classify Text? Some Learnings from the TrenchesPyDataSep 26, 2024 “…practical implications of using GenAI for text classification tasks. The speakers highlighted challenges suchContinue readingWhat I Watch: GenAI, Classify Text

What I Read: Extrinsic Hallucinations, LLMs

By Andrew Fairless on October 7, 2024July 14, 2024

https://lilianweng.github.io/posts/2024-07-07-hallucination Extrinsic Hallucinations in LLMsLilian WengJuly 7, 2024 “This post focuses on extrinsic hallucination. To avoid hallucination, LLMs need to be (1) factual and (2) acknowledge not knowing the answerContinue readingWhat I Read: Extrinsic Hallucinations, LLMs

What I Read: Data Selection, LLMs

By Andrew Fairless on June 12, 2024April 15, 2024

https://www.cs.princeton.edu/~smalladi/blog/2024/04/04/dataselection Using LESS Data to Tune Models: Data Selection in the Era of LLMsMengzhou Xia and Sadhika MalladiApril 04 2024 “We describe how data selection for modern-day LLMs differs fromContinue readingWhat I Read: Data Selection, LLMs

What I Read: LoRA from Scratch

By Andrew Fairless on April 4, 2024March 1, 2024

https://lightning.ai/lightning-ai/studios/code-lora-from-scratch Code LoRA from ScratchSebastian Raschka “LoRA, which stands for Low-Rank Adaptation, is a popular technique to finetune LLMs more efficiently,,,. This Studio explains how LoRA works by coding itContinue readingWhat I Read: LoRA from Scratch

Tag: fine tuning