What I Learn – Andrew Fairless, Ph.D.

What I Read: Classifying pdfs

By Andrew Fairless on November 21, 2024August 26, 2024

https://snats.xyz/pages/articles/classifying_a_bunch_of_pdfs.html Classifying all of the pdfs on the internetSantiago Pedroza2024-08-18 “How would you classify all the pdfs in the internet? Well, that is what I tried doing this time.”

What I Read: Tool Retrieval, RAG

By Andrew Fairless on November 20, 2024August 26, 2024

https://jxnl.co/writing/2024/08/21/trade-off-tool-selection Optimizing Tool Retrieval in RAG Systems: A Balanced ApproachJason Liu2024/08/21 “When it comes to Retrieval-Augmented Generation (RAG) systems, one of the key challenges is deciding how to select andContinue readingWhat I Read: Tool Retrieval, RAG

What I Read: LLM Pre-training Post-training

By Andrew Fairless on November 18, 2024August 26, 2024

https://magazine.sebastianraschka.com/p/new-llm-pre-training-and-post-training New LLM Pre-training and Post-training ParadigmsA Look at How Modern LLMs Are TrainedSebastian Raschka, PhDAug 17, 2024 “Initially, the LLM training process focused solely on pre-training, but it hasContinue readingWhat I Read: LLM Pre-training Post-training

What I Read: Difference, Statements and Expressions

By Andrew Fairless on November 14, 2024August 26, 2024

The Difference Between Statements and Expressions The Difference Between Statements and ExpressionsWritten by Jeremy Grifski inJune 28, 2019Last Updated May 27, 2024 “Unfortunately, while the definitions I’ve provided are cleanContinue readingWhat I Read: Difference, Statements and Expressions

What I Read: Open-endedness, Agentic AI

By Andrew Fairless on November 13, 2024August 25, 2024

https://press.airstreet.com/p/open-endedness-is-all-well-need Open-endedness is all we’ll need: On “Agentic AI”Air Street Capital, Nathan Benaich, and Alex ChalmersAug 15, 2024 “Agentic systems offer the promise of agents – a software system thatContinue readingWhat I Read: Open-endedness, Agentic AI

What I Read: Turing Test, intelligence

By Andrew Fairless on November 12, 2024August 25, 2024

https://www.science.org/doi/10.1126/science.adq9356 The Turing Test and our shifting conceptions of intelligenceMelanie MitchellScienceVol 385, Issue 6710DOI: 10.1126/science.adq935615 Aug 2024 “It’s likely that the Turing Test will become yet another casualty of ourContinue readingWhat I Read: Turing Test, intelligence

What I Read: Regularization, polynomial bases

By Andrew Fairless on November 7, 2024August 25, 2024

https://alexshtf.github.io/2024/06/03/PolynomialBasesRegProps.html Alex ShtoffRegularization properties of polynomial basesJun 3, 2024 “We used the Bernstein basis to demonstrate the importance of chosing a “good” polynomial basis, and that other well-known bases mayContinue readingWhat I Read: Regularization, polynomial bases

What I Read: Contextual Bandit, LinUCB:

By Andrew Fairless on November 5, 2024August 15, 2024

https://truetheta.io/concepts/reinforcement-learning/lin-ucb A Reliable Contextual Bandit Algorithm: LinUCBDJ RichAugust 6, 2024 “A user visits a news website. Which articles should they be shown?”

What I Read: Big Data is Dead

By Andrew Fairless on November 4, 2024August 3, 2024

https://motherduck.com/blog/big-data-is-dead Big Data is DeadJordan Tigani2023/02/07 “Misunderstanding of this point leads to a lot of the discussion of Big Data, because techniques for dealing with large compute requirements are differentContinue readingWhat I Read: Big Data is Dead

What I Read: Visual Guide, Quantization

By Andrew Fairless on October 30, 2024August 3, 2024

https://newsletter.maartengrootendorst.com/p/a-visual-guide-to-quantization A Visual Guide to Quantization, Demystifying the Compression of Large Language ModelsMaarten GrootendorstJul 22, 2024 “…I will introduce the field of quantization in the context of language modeling andContinue readingWhat I Read: Visual Guide, Quantization

Category: What I Learn