https://www.microsoft.com/en-us/research/blog/three-mysteries-in-deep-learning-ensemble-knowledge-distillation-and-self-distillation/ Three mysteries in deep learning: Ensemble, knowledge distillation, and self-distillationPublished January 19, 2021By Zeyuan Allen-Zhu , Senior Researcher Yuanzhi Li , Assistant Professor, Carnegie Mellon University “…besides this small
What I Read: Transformer Networks to Answer Questions About Images
https://medium.com/dataseries/microsoft-uses-transformer-networks-to-answer-questions-about-images-with-minimum-training-f978c018bb72 Microsoft Uses Transformer Networks to Answer Questions About Images With Minimum TrainingUnified VLP can understand concepts about scenic images by using pretrained models.Jesus RodriguezJan 12 “Can we build deep
What I Read: Medicine’s Machine Learning Problem
https://bostonreview.net/science-nature/rachel-thomas-medicines-machine-learning-problem Science & NatureMedicine’s Machine Learning ProblemAs Big Data tools reshape health care, biased datasets and unaccountable algorithms threaten to further disempower patients.Rachel Thomas “…it is crucial to acknowledge that