large language model – Page 9 – Andrew Fairless, Ph.D.

What I Read: Distributed Training, Finetuning

By Andrew Fairless on December 20, 2023November 7, 2023

https://sumanthrh.com/post/distributed-and-efficient-finetuning/ Everything about Distributed Training and Efficient FinetuningSumanth R HegdeLast updated on Oct 13, 2023 “practical guidelines and gotchas with multi-GPU and multi-node training”

What I Read: Artificial General Intelligence

By Andrew Fairless on December 19, 2023November 7, 2023

Artificial General Intelligence Is Already Here Artificial General Intelligence Is Already HereBy Blaise Agüera y Arcas and Peter NorvigOctober 10, 2023 “Today’s most advanced AI models have many flaws, butContinue readingWhat I Read: Artificial General Intelligence

What I Read: Tiny Language Models

By Andrew Fairless on December 11, 2023October 12, 2023

https://www.quantamagazine.org/tiny-language-models-thrive-with-gpt-4-as-a-teacher-20231005/ Tiny Language Models Come of AgeBen Brubaker10/5/23 10:50 AM “To better understand how neural networks learn to simulate writing, researchers trained simpler versions on synthetic children’s stories.”

What I Read: LLM Apps, Data Pipelines

By Andrew Fairless on December 7, 2023November 20, 2023

https://meltano.com/blog/llm-apps-are-mostly-data-pipelines/ LLM Apps Are Mostly Data PipelinesPat NadolnyAugust 22 2023 “While the existing LLM app tools like LangChain and LlamaIndex are useful for building LLM apps… you should heavily considerContinue readingWhat I Read: LLM Apps, Data Pipelines

What I Read: evaluating AI systems

By Andrew Fairless on December 5, 2023October 12, 2023

https://www.anthropic.com/index/evaluating-ai-systems Challenges in evaluating AI systemsOct 4, 2023 “…what many people working inside and outside of AI don’t fully appreciate is how difficult it is to build robust and reliableContinue readingWhat I Read: evaluating AI systems

What I Read: Problems of AI Consciousness

By Andrew Fairless on December 4, 2023October 5, 2023

https://thegradient.pub/an-introduction-to-the-problems-of-ai-consciousness/ An Introduction to the Problems of AI ConsciousnessNick Alonso9/30/23 “This brief introduction is aimed at those working within the AI community who are interested in AI consciousness, but mayContinue readingWhat I Read: Problems of AI Consciousness

What I Read: Privacy side channels in ML

By Andrew Fairless on November 27, 2023October 5, 2023

https://spylab.ai/blog/side-channels-machine-learning/ Privacy side channels in machine learning systemsEdoardo Debenedetti, Florian TramèrSep 12, 2023 “An additional application of our membership inference attack is to test whether specific data sources were partContinue readingWhat I Read: Privacy side channels in ML

What I Read: Estimate Token Importance in LLM Prompts

By Andrew Fairless on November 16, 2023October 5, 2023

https://www.watchful.io/blog/a-surprisingly-effective-way-to-estimate-token-importance-in-llm-prompts A Surprisingly Effective Way to Estimate Token Importance in LLM PromptsShayan Mohanty “Prompting is our primary means of instructing these AIs, yet the process of crafting effective prompts hasContinue readingWhat I Read: Estimate Token Importance in LLM Prompts

What I Read: How make history with LLMs

By Andrew Fairless on November 8, 2023October 5, 2023

https://leighmariebraswell.substack.com/p/how-to-make-history-with-llms-and How to make history with LLMs & other generative modelsLeigh Marie BraswellSep 21, 2023 “Over the past year I’ve talked to many founders, operators, and investors, and I’ve encounteredContinue readingWhat I Read: How make history with LLMs

What I Read: Optimizing LLM in production

By Andrew Fairless on November 6, 2023October 5, 2023

https://huggingface.co/blog/optimize-llm Optimizing your LLM in productionSeptember 15, 2023Patrick von Platen “…efficient LLM deployment…. pros and cons of adopting lower precision, provide a comprehensive exploration of the latest attention algorithms, andContinue readingWhat I Read: Optimizing LLM in production

Tag: large language model