What I Learn – Page 31 – Andrew Fairless, Ph.D.

What I Read: What, Why ChatGPT

By Andrew Fairless on July 12, 2023June 15, 2023

https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-doing-and-why-does-it-work/ What Is ChatGPT Doing … and Why Does It Work?February 14, 2023Stephen Wolfram “That ChatGPT can automatically generate something that reads even superficially like human-written text is remarkable, andContinue readingWhat I Read: What, Why ChatGPT

What I Read: In-Context Learning

By Andrew Fairless on July 11, 2023May 31, 2023

https://thegradient.pub/in-context-learning-in-context/ In-Context Learning, In ContextDaniel Bashir29.Apr.2023 “…in-context learning (ICL). In this paradigm, an LLM learns to solve a new task at inference time (without any change to its weights) byContinue readingWhat I Read: In-Context Learning

What I Read: AIs producing own training data

By Andrew Fairless on July 10, 2023May 31, 2023

https://thegradient.pub/software2-a-new-generation-of-ais-that-become-increasingly-general-by-producing-their-own-training-data/ Software²: A new generation of AIs that become increasingly general by producing their own training dataMinqi Jiang22.Apr.2023 “We are at the cusp of transitioning from “learning from data” toContinue readingWhat I Read: AIs producing own training data

What I Read: Scaling Up

By Andrew Fairless on July 6, 2023May 31, 2023

https://motherduck.com/blog/the-simple-joys-of-scaling-up/ The Simple Joys of Scaling UpJordan Tigani2023/05/11 “If you can do the job on a single machine, isn’t that going to be a better alternative?”

What I Read: Natural Language, supply chains

By Andrew Fairless on July 5, 2023May 31, 2023

https://datasciencecampus.ons.gov.uk/using-natural-language-processing-for-the-analysis-of-global-supply-chains/ Using Natural Language Processing for the analysis of global supply chainsIoannis Kaloskampis Bernard Peat Charles McGowan Paige Hunter Melissa Bui David BradnumMay 11, 2023 “…we explored whether cutting-edge dataContinue readingWhat I Read: Natural Language, supply chains

What I Read: Against LLM

By Andrew Fairless on June 29, 2023May 31, 2023

https://explosion.ai/blog/against-llm-maximalism Against LLM maximalismby Matthew HonnibalMay 18, 2023 “However, LLMs are not a direct solution to most of the NLP use-cases companies have been working on… if you want toContinue readingWhat I Read: Against LLM

What I Read: Chatbots, What Isn’t

By Andrew Fairless on June 28, 2023May 31, 2023

https://www.quantamagazine.org/ai-like-chatgpt-are-no-good-at-not-20230512/ Chatbots Don’t Know What Stuff Isn’tMax G. LevyMay 12, 2023 “Today’s language models are more sophisticated than ever, but they still struggle with the concept of negation. That’s unlikelyContinue readingWhat I Read: Chatbots, What Isn’t

What I Read: Reinforcement Learning from Human Feedback

By Andrew Fairless on June 27, 2023May 31, 2023

https://huyenchip.com//2023/05/02/rlhf.html RLHF: Reinforcement Learning from Human FeedbackChip HuyenMay 2, 2023 “…making models like ChatGPT work. One such cool idea is RLHF (Reinforcement Learning from Human Feedback)…. So, how exactly doesContinue readingWhat I Read: Reinforcement Learning from Human Feedback

What I Read: Reinforcement Learning, Language Models

By Andrew Fairless on June 21, 2023May 1, 2023

https://gist.github.com/yoavg/6bff0fecd65950898eba1bb321cfbd81 Reinforcement Learning for Language ModelsYoav Goldberg, April 2023. “With the release of the ChatGPT model… there was a lot of discussion of the importance of “RLHF training”, that is,Continue readingWhat I Read: Reinforcement Learning, Language Models

What I Read: Computation, Artificial Intelligence

By Andrew Fairless on June 20, 2023May 1, 2023

https://www.quantamagazine.org/a-new-approach-to-computation-reimagines-artificial-intelligence-20230413/ A New Approach to Computation Reimagines Artificial IntelligenceAnil AnanthaswamyApril 13, 2023 “By imbuing enormous vectors with semantic meaning, we can get machines to reason more abstractly — and efficientlyContinue readingWhat I Read: Computation, Artificial Intelligence

Category: What I Learn