fine tuning – Andrew Fairless, Ph.D.

What I Read: Extrinsic Hallucinations, LLMs

By Andrew Fairless on October 7, 2024July 14, 2024

https://lilianweng.github.io/posts/2024-07-07-hallucination Extrinsic Hallucinations in LLMsLilian WengJuly 7, 2024 “This post focuses on extrinsic hallucination. To avoid hallucination, LLMs need to be (1) factual and (2) acknowledge not knowing the answerContinue readingWhat I Read: Extrinsic Hallucinations, LLMs

What I Read: Data Selection, LLMs

By Andrew Fairless on June 12, 2024April 15, 2024

https://www.cs.princeton.edu/~smalladi/blog/2024/04/04/dataselection Using LESS Data to Tune Models: Data Selection in the Era of LLMsMengzhou Xia and Sadhika MalladiApril 04 2024 “We describe how data selection for modern-day LLMs differs fromContinue readingWhat I Read: Data Selection, LLMs

What I Read: LoRA from Scratch

By Andrew Fairless on April 4, 2024March 1, 2024

https://lightning.ai/lightning-ai/studios/code-lora-from-scratch Code LoRA from ScratchSebastian Raschka “LoRA, which stands for Low-Rank Adaptation, is a popular technique to finetune LLMs more efficiently,,,. This Studio explains how LoRA works by coding itContinue readingWhat I Read: LoRA from Scratch

Tag: fine tuning