https://deepmind.com/blog/article/EigenGame 06 May 2021Game theory as an engine for large-scale data analysisBrian McWilliamsIan GempClaire Vernade “…we reformulated principal component analysis (PCA)… as a competitive multi-agent game we call EigenGame. PCA
What I Read: Branch Specialization
https://distill.pub/2020/circuits/branch-specialization/ Branch SpecializationChelsea VossGabriel GohNick CammarataMichael PetrovLudwig SchubertChris OlahApril 5, 2021DOI 10.23915/distill.00024.008 “Branch specialization occurs when neural network layers are split up into branches. The neurons and circuits tend to
What I Read: Visualizing Weights
https://distill.pub/2020/circuits/visualizing-weights/ Visualizing WeightsChelsea VossNick CammarataGabriel GohMichael PetrovLudwig SchubertBen EganSwee Kiat LimChris OlahFeb. 4, 2021DOI 10.23915/distill.00024.007 “The problem of understanding a neural network is a little bit like reverse engineering a
What I Read: Brain ‘Rotates’ Memories to Save Them From New Sensations
https://www.quantamagazine.org/the-brain-rotates-memories-to-save-them-from-new-sensations-20210415/ The Brain ‘Rotates’ Memories to Save Them From New SensationsJordana CepelewiczStaff WriterApril 15, 2021 “Some populations of neurons simultaneously process sensations and memories. New work shows how the brain
What I Read: Neural Nets, How Brains Learn
https://www.quantamagazine.org/artificial-neural-nets-finally-yield-clues-to-how-brains-learn-20210218/ Artificial Neural Nets Finally Yield Clues to How Brains LearnAnil AnanthaswamyContributing WriterFebruary 18, 2021 “The learning algorithm that enables the runaway success of deep neural networks doesn’t work in
What I Read: Neural Networks Help Explain Brains
https://www.quantamagazine.org/deep-neural-networks-help-to-explain-living-brains-20201028/ neuroscienceDeep Neural Networks Help to Explain Living Brains Deep neural networks, often criticized as “black boxes,” are helping neuroscientists understand the organization of living brains.“If their CNN mimicked a