https://magazine.sebastianraschka.com/p/practical-tips-for-finetuning-llms
Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation)
Sebastian Raschka, PhD
Nov 19, 2023
“Low-rank adaptation (LoRA) is among the most widely used and effective techniques for efficiently training custom LLMs…. This Ahead of AI article aims to discuss the primary lessons I derived from my experiments.”