BI 052 Andrew Saxe: Deep Learning Theory

November 06, 2019 • 01:25:48
BI 052 Andrew Saxe: Deep Learning Theory
Brain Inspired
BI 052 Andrew Saxe: Deep Learning Theory

Nov 06 2019 | 01:25:48

/

Show Notes

Support the Podcast

Andrew and I discuss his work exploring how various facets of deep networks contribute to their function, i.e. deep network theory. We talk about what he’s learned by studying linear deep networks and asking how depth and initial weights affect learning dynamics, when replay is appropriate (and when it’s not), how semantics develop, and what it all might tell us about deep learning in brains.

Show notes:

A few recommended texts to dive deeper:

Other Episodes

Episode 0

October 22, 2025 • 01:39:01
Episode Cover

BI 223 Vicente Raja: Ecological Psychology Motifs in Neuroscience

Support the show to get full episodes, full archive, and join the Discord community. Vicente Raja is a research fellow at University of Murcia...

Listen

Episode 0

May 07, 2025 • 01:59:40
Episode Cover

BI 211 COGITATE: Testing Theories of Consciousness

Support the show to get full episodes, full archive, and join the Discord community. The Transmitter is an online publication that aims to deliver...

Listen

Episode 0

November 05, 2025 • 01:49:02
Episode Cover

BI 224 Dan Nicholson: Schrödinger's What is Life? Revisited

Support the show to get full episodes, full archive, and join the Discord community. The Transmitter is an online publication that aims to deliver...

Listen