contrastive – Andrew Fairless, Ph.D.

What I Read: Instruction Tuning

By Andrew Fairless on February 19, 2024December 19, 2023

https://gaotianyu.xyz/blog/2023/11/30/instruction-tuning/ Teach Llamas to Talk: Recent Progress in Instruction TuningTianyu Gao30 November 2023 “…open-ended instruction tuning… fine-tunes an LLM such that it can follow user instructions…. there have been numerousContinue readingWhat I Read: Instruction Tuning

What I Read: Applying BERT to Speech

By Andrew Fairless on June 27, 2022June 27, 2022

https://thegradient.pub/an-illustrated-tour-of-applying-bert-to-speech-data/ An Illustrated Tour of Applying BERT to Speech DataJonathan Boigne10.May.2022 “Could we replace the text input in BERT with a speech sequence, mask a part of it, and similarlyContinue readingWhat I Read: Applying BERT to Speech

What I Read: Type-Aware Bi-Encoders for Open-Domain Entity Retrieval

By Andrew Fairless on May 31, 2022April 25, 2022

https://hazyresearch.stanford.edu/blog/2022-04-19-contrastive-3 TABi: Type-Aware Bi-Encoders for Open-Domain Entity RetrievalApr 19, 2022Megan Leszczynski, Dan Fu, Mayee Chen, and Chris Ré. “We introduce a method to improve retrieval of rare entities by incorporatingContinue readingWhat I Read: Type-Aware Bi-Encoders for Open-Domain Entity Retrieval

What I Read: Supervised Contrastive Learning

By Andrew Fairless on May 30, 2022April 25, 2022

https://hazyresearch.stanford.edu/blog/2022-04-19-contrastive-2 Improving Transfer and Robustness in Supervised Contrastive LearningApr 19, 2022 Mayee Chen, Dan Fu, Avanika Narayan, Michael Zhang, Zhao Song, Kayvon Fatahalian , and Chris Ré. “A major problemContinue readingWhat I Read: Supervised Contrastive Learning

Tag: contrastive