reinforcement learning – Page 2 – Andrew Fairless, Ph.D.

What I Read: Instruction Tuning

By Andrew Fairless on February 19, 2024December 19, 2023

https://gaotianyu.xyz/blog/2023/11/30/instruction-tuning/ Teach Llamas to Talk: Recent Progress in Instruction TuningTianyu Gao30 November 2023 “…open-ended instruction tuning… fine-tunes an LLM such that it can follow user instructions…. there have been numerousContinue readingWhat I Read: Instruction Tuning

What I Read: Will Scaling Solve Robotics?

By Andrew Fairless on February 15, 2024December 19, 2023

https://nishanthjkumar.com/Will-Scaling-Solve-Robotics-Perspectives-from-CoRL-2023/ Will Scaling Solve Robotics?: Perspectives From Corl 2023Nishanth J. Kumar “…is training a large neural network on a very large dataset a feasible way to solve robotics?”

What I Read: AI System Beats Chess Puzzles

By Andrew Fairless on December 12, 2023November 20, 2023

https://www.quantamagazine.org/google-deepmind-trains-artificial-brainstorming-in-chess-ai-20231115/ AI System Beats Chess Puzzles With ‘Artificial Brainstorming’Stephen OrnesNovember 15, 2023 “By bringing together disparate approaches, machines can reach a new level of creative problem-solving.”

What I Read: LLM Training, RLHF

By Andrew Fairless on October 30, 2023October 5, 2023

https://magazine.sebastianraschka.com/p/llm-training-rlhf-and-its-alternatives LLM Training: RLHF and Its AlternativesSebastian Raschka, PhDSep 10, 2023 “RLHF is an integral part of the modern LLM training pipeline due to its ability to incorporate human preferencesContinue readingWhat I Read: LLM Training, RLHF

What I Read: LLMs

By Andrew Fairless on September 7, 2023August 1, 2023

https://willthompson.name/what-we-know-about-llms-primer What We Know About LLMs (Primer)Will Thompson (Twitter)July 23, 2023 “…it is worth reflecting on what we concretely know about LLMs at this point in time and how theseContinue readingWhat I Read: LLMs

What I Read: LLM Agents

By Andrew Fairless on August 17, 2023July 9, 2023

https://lilianweng.github.io/posts/2023-06-23-agent/ LLM Powered Autonomous AgentsLilian WengJune 23, 2023 “Building agents with LLM (large language model) as its core controller is a cool concept…. it can be framed as a powerfulContinue readingWhat I Read: LLM Agents

What I Read: AIs producing own training data

By Andrew Fairless on July 10, 2023May 31, 2023

https://thegradient.pub/software2-a-new-generation-of-ais-that-become-increasingly-general-by-producing-their-own-training-data/ Software²: A new generation of AIs that become increasingly general by producing their own training dataMinqi Jiang22.Apr.2023 “We are at the cusp of transitioning from “learning from data” toContinue readingWhat I Read: AIs producing own training data

What I Read: Reinforcement Learning from Human Feedback

By Andrew Fairless on June 27, 2023May 31, 2023

https://huyenchip.com//2023/05/02/rlhf.html RLHF: Reinforcement Learning from Human FeedbackChip HuyenMay 2, 2023 “…making models like ChatGPT work. One such cool idea is RLHF (Reinforcement Learning from Human Feedback)…. So, how exactly doesContinue readingWhat I Read: Reinforcement Learning from Human Feedback

What I Read: Reinforcement Learning, Language Models

By Andrew Fairless on June 21, 2023May 1, 2023

https://gist.github.com/yoavg/6bff0fecd65950898eba1bb321cfbd81 Reinforcement Learning for Language ModelsYoav Goldberg, April 2023. “With the release of the ChatGPT model… there was a lot of discussion of the importance of “RLHF training”, that is,Continue readingWhat I Read: Reinforcement Learning, Language Models

What I Read: human touch, LLMs

By Andrew Fairless on May 23, 2023May 1, 2023

https://mewelch.substack.com/p/putting-the-human-touch-on-llms Putting the human touch on LLMsMolly WelchMar 30 “Techniques like RLHF help align large language models with people’s values and preferences. Is that a good thing?”

Tag: reinforcement learning