distillation – Page 2 – Andrew Fairless, Ph.D.

What I Read: Data-efficient image Transformers

By Andrew Fairless on March 5, 2021March 5, 2021

Data-efficient image Transformers: A promising new technique for image classificationDecember 23, 2020 “We’ve developed a new method to train computer vision models that leverage Transformers…. Our new technique — Data-efficientContinue readingWhat I Read: Data-efficient image Transformers

What I Read: “Less than one”-shot learning

By Andrew Fairless on February 4, 2021January 10, 2021

https://www.technologyreview.com/2020/10/16/1010566/ai-machine-learning-with-tiny-data/ Artificial intelligence/Machine learningA radical new technique lets AI learn with practically no data“Less than one”-shot learning can teach a model to identify more objects than the number of examplesContinue readingWhat I Read: “Less than one”-shot learning

What I Read: Can a neural network train other networks?

By Andrew Fairless on January 31, 2021January 6, 2021

https://towardsdatascience.com/can-a-neural-network-train-other-networks-cf371be516c6?gi=4765ee11be44 Can a neural network train other networks?An introduction to knowledge distillationTivadar DankaOct 5 “Now you have a huge model, which, although performs excellently, there is no way to deployContinue readingWhat I Read: Can a neural network train other networks?

Tag: distillation