tuning – Andrew Fairless, Ph.D.

What I Read: LLM evaluation

By Andrew Fairless on October 21, 2024July 22, 2024

https://hamel.dev/blog/posts/evals Your AI Product Needs EvalsHow to construct domain-specific LLM evaluation systems.Hamel HusainMarch 29, 2024 “…I’ve seen many successful and unsuccessful approaches to building LLM products. I’ve found that unsuccessfulContinue readingWhat I Read: LLM evaluation

What I Read: LLMs, Open Source

By Andrew Fairless on July 15, 2024May 6, 2024

https://www.aidancooper.co.uk/how-to-beat-proprietary-llms How to Beat Proprietary LLMs With Smaller Open Source ModelsAidan CooperApr 26, 2024 “…we explore the unique advantages of open source LLMs, and how you can leverage them toContinue readingWhat I Read: LLMs, Open Source

What I Read: Instruction Tuning

By Andrew Fairless on February 19, 2024December 19, 2023

https://gaotianyu.xyz/blog/2023/11/30/instruction-tuning/ Teach Llamas to Talk: Recent Progress in Instruction TuningTianyu Gao30 November 2023 “…open-ended instruction tuning… fine-tunes an LLM such that it can follow user instructions…. there have been numerousContinue readingWhat I Read: Instruction Tuning

What I Read: Enterprise AI, RAG + Fine Tuning

By Andrew Fairless on January 11, 2024November 20, 2023

https://www.montecarlodata.com/blog-the-moat-for-enterprise-ai-is-rag-fine-tuning/ The Moat for Enterprise AI is RAG + Fine Tuning – Here’s WhyLior GavishUpdated Nov 09 2023 “Data needs to be secure and private; LLM deployment needs to beContinue readingWhat I Read: Enterprise AI, RAG + Fine Tuning

What I Read: LLM Training, RLHF

By Andrew Fairless on October 30, 2023October 5, 2023

https://magazine.sebastianraschka.com/p/llm-training-rlhf-and-its-alternatives LLM Training: RLHF and Its AlternativesSebastian Raschka, PhDSep 10, 2023 “RLHF is an integral part of the modern LLM training pipeline due to its ability to incorporate human preferencesContinue readingWhat I Read: LLM Training, RLHF

What I Read: LLMs, single example

By Andrew Fairless on October 23, 2023September 9, 2023

https://www.fast.ai/posts/2023-09-04-learning-jumps/ Can LLMs learn from a single example?Jeremy Howard and Jonathan WhitakerSeptember 4, 2023 “We’ve noticed an unusual training pattern in fine-tuning LLMs. At first we thought it’s a bug,Continue readingWhat I Read: LLMs, single example

What I Read: LLMs

By Andrew Fairless on September 7, 2023August 1, 2023

https://willthompson.name/what-we-know-about-llms-primer What We Know About LLMs (Primer)Will Thompson (Twitter)July 23, 2023 “…it is worth reflecting on what we concretely know about LLMs at this point in time and how theseContinue readingWhat I Read: LLMs

What I Read: Gaussian Process, Active Learning in Physics

By Andrew Fairless on January 17, 2022December 11, 2021

https://towardsdatascience.com/gaussian-process-first-step-towards-active-learning-in-physics-239a8b260579?gi=41cc7e15ddd0 Gaussian Process: First Step Towards Active Learning in PhysicsMaxim ZiatdinovNov 1 “An approach to address these problems is a Gaussian Process…. we would like to offer a slightly unusualContinue readingWhat I Read: Gaussian Process, Active Learning in Physics

What I Read: Neural Text Generation

By Andrew Fairless on March 11, 2021March 7, 2021

https://lilianweng.github.io/lil-log/2021/01/02/controllable-neural-text-generation.html Controllable Neural Text GenerationJan 2, 2021Lilian Weng “How to steer a powerful unconditioned language model? In this post, we will delve into several approaches for controlled content generation withContinue readingWhat I Read: Neural Text Generation

Tag: tuning