neural network – Page 19 – Andrew Fairless, Ph.D.

What I Read: Diffusion Models

By Andrew Fairless on August 18, 2021July 22, 2021

https://lilianweng.github.io/lil-log/2021/07/11/diffusion-models.html#nice What are Diffusion Models?Jul 11, 2021Lilian Weng“Diffusion models are inspired by non-equilibrium thermodynamics…. Unlike VAE or flow models, diffusion models are learned with a fixed procedure and the latentContinue readingWhat I Read: Diffusion Models

What I Read: Geometric, Deep Learning

By Andrew Fairless on August 16, 2021July 22, 2021

https://towardsdatascience.com/geometric-foundations-of-deep-learning-94cdd45b451d?gi=d7fa7307aa63 Geometric foundations of Deep LearningGeometric Deep Learning is an attempt for geometric unification of a broad class of ML problems from the perspectives of symmetry and invariance. These principlesContinue readingWhat I Read: Geometric, Deep Learning

What I Read: Training AI, Analogies

By Andrew Fairless on August 13, 2021July 22, 2021

https://www.quantamagazine.org/melanie-mitchell-trains-ai-to-think-with-analogies-20210714/ The Computer Scientist Training AI to Think With AnalogiesMelanie Mitchell has worked on digital minds for decades. She says they’ll never truly be like ours until they can makeContinue readingWhat I Read: Training AI, Analogies

What I Read: Identifying Document Types

By Andrew Fairless on August 11, 2021July 22, 2021

https://tech.scribd.com/blog/2021/identifying-document-types.html Identifying Document Types at ScribdJonathan RamkissoonJuly 12, 2021 “User-uploaded documents have been a core component of Scribd’s business from the very beginning, understanding what is actually in the documentContinue readingWhat I Read: Identifying Document Types

What I Read: Prompting, Language Models, NLP

By Andrew Fairless on August 9, 2021July 22, 2021

https://thegradient.pub/prompting/ Prompting: Better Ways of Using Language Models for NLP Tasks03.Jul.2021Tianyu Gao “The giant model size of GPT-3 is an important factor for its success, while the concept of promptsContinue readingWhat I Read: Prompting, Language Models, NLP

What I Read: Gradient Pseudo-Swap

By Andrew Fairless on August 3, 2021July 12, 2021

https://deepnote.com/@martin-molnar/Gradient-Pseudo-Swap-F2u_aTbqTOisNYCH_JORwg Martin MolnarGradient Pseudo-Swap “When we have layers in a neural network we want to train with gradient descent, but those layers don’t have smooth gradients that can be used,Continue readingWhat I Read: Gradient Pseudo-Swap

What I Read: SwAV method

By Andrew Fairless on August 2, 2021July 12, 2021

https://m0nads.wordpress.com/2021/01/08/the-swav-method/ The SwAV methodAntonio Ferraioli “The SwAV method is a clustering-based online method whose goal is to learn visual features in an online fashion without supervision.”

What I Read: CNN Heat Maps, Class Activation Mapping

By Andrew Fairless on July 30, 2021July 12, 2021

https://glassboxmedicine.com/2019/06/11/cnn-heat-maps-class-activation-mapping-cam/ CNN Heat Maps: Class Activation Mapping (CAM)Date: June 11, 2019Author: Rachel Draelos “Class Activation Mapping (CAM) is one technique for producing heat maps to highlight class-specific regions of images.”

What I Read: Representation quality, complexity

By Andrew Fairless on July 29, 2021July 12, 2021

https://willwhitney.com/representation-quality-and-the-complexity-of-learning.html Will WhitneyRepresentation quality and the complexity of learning “In the last few years, there’s been an explosion of work on learning good representations of data…. However, defining precisely whatContinue readingWhat I Read: Representation quality, complexity

What I Read: Parallelizing neural networks, GPU, JAX

By Andrew Fairless on July 28, 2021July 12, 2021

https://willwhitney.com/parallel-training-jax.html Will WhitneyParallelizing neural networks on one GPU with JAX How you can get a 100x speedup for training small neural networks by making the most of your accelerator.“Most neuralContinue readingWhat I Read: Parallelizing neural networks, GPU, JAX

Tag: neural network