similarity – Andrew Fairless, Ph.D.

What I Read: Estimate Token Importance in LLM Prompts

By Andrew Fairless on November 16, 2023October 5, 2023

https://www.watchful.io/blog/a-surprisingly-effective-way-to-estimate-token-importance-in-llm-prompts A Surprisingly Effective Way to Estimate Token Importance in LLM PromptsShayan Mohanty “Prompting is our primary means of instructing these AIs, yet the process of crafting effective prompts hasContinue readingWhat I Read: Estimate Token Importance in LLM Prompts

What I Read: To Understand Transformers, Focus on Attention

By Andrew Fairless on October 16, 2023September 4, 2023

https://drscotthawley.github.io/blog/posts/Transformers1-Attention.html To Understand Transformers, Focus on AttentionScott H. HawleyAugust 21, 2023 “To Understand Transformers, Focus on Attention”

What I Read: Multimodal, Embeddings

By Andrew Fairless on October 5, 2023September 4, 2023

https://app.twelvelabs.io/blog/multimodal-embeddings The Multimodal Evolution of Vector EmbeddingsJames LeAugust 9, 2023 “…companies collect and feed hundreds of millions of terabytes of multimodal data into deep learning models. As a result, embeddings…Continue readingWhat I Read: Multimodal, Embeddings

What I Read: Compare Two Ranked Lists

By Andrew Fairless on March 9, 2023January 30, 2023

https://towardsdatascience.com/how-to-objectively-compare-two-ranked-lists-in-python-b3d74e236f6a How to Objectively Compare Two Ranked Lists in PythonKrupesh RaikarJan 5 “Apart from the above movie viewing order disagreement, we are surrounded by examples of comparing lists!…. Ideally, aContinue readingWhat I Read: Compare Two Ranked Lists

What I Read: Semantic Search

By Andrew Fairless on July 20, 2021July 2, 2021

https://www.pinecone.io/learn/semantic-search/ Semantic Search: Measuring Meaning From Jaccard to BertJames BriggsData Scientist “Similarity search is a complex topic and there are countless techniques for building effective search engines. In this article,Continue readingWhat I Read: Semantic Search

What I Read: Contrastive Representation Learning

By Andrew Fairless on July 1, 2021June 7, 2021

https://lilianweng.github.io/lil-log/2021/05/31/contrastive-representation-learning.html Contrastive Representation Learningby Lilian WengMay 31, 2021 “The goal of contrastive representation learning is to learn such an embedding space in which similar sample pairs stay close to eachContinue readingWhat I Read: Contrastive Representation Learning

What I Read: What is a Vector Database?

By Andrew Fairless on June 4, 2021May 14, 2021

https://www.pinecone.io/learn/vector-database/ What is a Vector Database?Rajat TripathiML Solutions Engineer “The meteoric rise in Machine Learning in the last few years has led to increasing use of vector embeddings…. The uniqueContinue readingWhat I Read: What is a Vector Database?

What I Read: Attention with Performers

By Andrew Fairless on February 7, 2021January 11, 2021

https://ai.googleblog.com/2020/10/rethinking-attention-with-performers.html Rethinking Attention with PerformersFriday, October 23, 2020Posted by Krzysztof Choromanski and Lucy Colwell, Research Scientists, Google Research “To resolve these issues, we introduce the Performer, a Transformer architecture withContinue readingWhat I Read: Attention with Performers

What I Read: ScaNN, Efficient Vector Similarity Search

By Andrew Fairless on January 14, 2021December 23, 2020

https://www.googblogs.com/announcing-scann-efficient-vector-similarity-search/ Announcing ScaNN: Efficient Vector Similarity SearchPosted by Philip Sun, Software Engineer, Google Research “Based on this intuition, we more heavily penalize quantization error that is parallel to the originalContinue readingWhat I Read: ScaNN, Efficient Vector Similarity Search

Tag: similarity