BI 052 Andrew Saxe: Deep Learning Theory

November 06, 2019 01:25:48
BI 052 Andrew Saxe: Deep Learning Theory
Brain Inspired
BI 052 Andrew Saxe: Deep Learning Theory

Nov 06 2019 | 01:25:48

/

Show Notes

Support the Podcast

Andrew and I discuss his work exploring how various facets of deep networks contribute to their function, i.e. deep network theory. We talk about what he’s learned by studying linear deep networks and asking how depth and initial weights affect learning dynamics, when replay is appropriate (and when it’s not), how semantics develop, and what it all might tell us about deep learning in brains.

Show notes:

A few recommended texts to dive deeper:

Other Episodes

Episode 0

July 27, 2020 01:19:04
Episode Cover

BI 079 Romain Brette: The Coding Brain Metaphor

Romain and I discuss his theoretical/philosophical work examining how neuroscientists rampantly misuse the word "code" when making claims about information processing in brains. We...

Listen

Episode

January 25, 2019 01:46:16
Episode Cover

BI 025 John Krakauer: Understanding Cognition

Show notes BLAM (Brain, Learning, Animation, and Movement) Lab homepage: http://blam-lab.org/ BLAM on Twitter: @blamlab Papers we discuss: Neuroscience Needs Behavior: Correcting a Reductionist...

Listen

Episode 0

June 16, 2020 01:22:35
Episode Cover

BI 074 Ginger Campbell: Are You Sure?

Ginger and I discuss her book Are You Sure? The Unconscious Origins of Certainty, which summarizes Richard Burton's work exploring the experience and phenomenal...

Listen