reinforcement learning – Page 2 – Andrew Fairless, Ph.D.

What I Read: LLM Training, RLHF

By Andrew Fairless on October 30, 2023October 5, 2023

https://magazine.sebastianraschka.com/p/llm-training-rlhf-and-its-alternatives LLM Training: RLHF and Its AlternativesSebastian Raschka, PhDSep 10, 2023 “RLHF is an integral part of the modern LLM training pipeline due to its ability to incorporate human preferencesContinue readingWhat I Read: LLM Training, RLHF

What I Read: LLMs

By Andrew Fairless on September 7, 2023August 1, 2023

https://willthompson.name/what-we-know-about-llms-primer What We Know About LLMs (Primer)Will Thompson (Twitter)July 23, 2023 “…it is worth reflecting on what we concretely know about LLMs at this point in time and how theseContinue readingWhat I Read: LLMs

What I Read: LLM Agents

By Andrew Fairless on August 17, 2023July 9, 2023

https://lilianweng.github.io/posts/2023-06-23-agent/ LLM Powered Autonomous AgentsLilian WengJune 23, 2023 “Building agents with LLM (large language model) as its core controller is a cool concept…. it can be framed as a powerfulContinue readingWhat I Read: LLM Agents

What I Read: AIs producing own training data

By Andrew Fairless on July 10, 2023May 31, 2023

https://thegradient.pub/software2-a-new-generation-of-ais-that-become-increasingly-general-by-producing-their-own-training-data/ Software²: A new generation of AIs that become increasingly general by producing their own training dataMinqi Jiang22.Apr.2023 “We are at the cusp of transitioning from “learning from data” toContinue readingWhat I Read: AIs producing own training data

What I Read: Reinforcement Learning from Human Feedback

By Andrew Fairless on June 27, 2023May 31, 2023

https://huyenchip.com//2023/05/02/rlhf.html RLHF: Reinforcement Learning from Human FeedbackChip HuyenMay 2, 2023 “…making models like ChatGPT work. One such cool idea is RLHF (Reinforcement Learning from Human Feedback)…. So, how exactly doesContinue readingWhat I Read: Reinforcement Learning from Human Feedback

What I Read: Reinforcement Learning, Language Models

By Andrew Fairless on June 21, 2023May 1, 2023

https://gist.github.com/yoavg/6bff0fecd65950898eba1bb321cfbd81 Reinforcement Learning for Language ModelsYoav Goldberg, April 2023. “With the release of the ChatGPT model… there was a lot of discussion of the importance of “RLHF training”, that is,Continue readingWhat I Read: Reinforcement Learning, Language Models

What I Read: human touch, LLMs

By Andrew Fairless on May 23, 2023May 1, 2023

https://mewelch.substack.com/p/putting-the-human-touch-on-llms Putting the human touch on LLMsMolly WelchMar 30 “Techniques like RLHF help align large language models with people’s values and preferences. Is that a good thing?”

What I Read: Competitive Machine Learning

By Andrew Fairless on May 9, 2023March 30, 2023

https://mlcontests.com/state-of-competitive-machine-learning-2022/ The State of Competitive Machine Learning2022 Edition “We summarise the state of the competitive landscape and analyse the 200+ competitions that took place in 2022. Plus a deep diveContinue readingWhat I Read: Competitive Machine Learning

What I Read: Teach Computers Math

By Andrew Fairless on April 6, 2023February 22, 2023

https://www.quantamagazine.org/to-teach-computers-math-researchers-merge-ai-approaches-20230215/ To Teach Computers Math, Researchers Merge AI ApproachesKevin HartnettFebruary 15, 2023 “Large language models still struggle with basic reasoning tasks. Two new papers that apply machine learning to mathContinue readingWhat I Read: Teach Computers Math

What I Read: Machines Learn, Teach Basics

By Andrew Fairless on March 21, 2023February 6, 2023

https://www.quantamagazine.org/machines-learn-better-if-we-teach-them-the-basics-20230201/ Machines Learn Better if We Teach Them the BasicsMax G. LevyFebruary 1, 2023 “A wave of research improves reinforcement learning algorithms by pre-training them as if they were human.”

Tag: reinforcement learning