BI 052 Andrew Saxe: Deep Learning Theory

November 06, 2019 01:25:48
BI 052 Andrew Saxe: Deep Learning Theory
Brain Inspired
BI 052 Andrew Saxe: Deep Learning Theory

Nov 06 2019 | 01:25:48

/

Show Notes

Support the Podcast

Andrew and I discuss his work exploring how various facets of deep networks contribute to their function, i.e. deep network theory. We talk about what he’s learned by studying linear deep networks and asking how depth and initial weights affect learning dynamics, when replay is appropriate (and when it’s not), how semantics develop, and what it all might tell us about deep learning in brains.

Show notes:

A few recommended texts to dive deeper:

Other Episodes

Episode 0

September 10, 2025 01:25:05
Episode Cover

BI 220 Michael Breakspear and Mac Shine: Dynamic Systems from Neurons to Brains

Support the show to get full episodes, full archive, and join the Discord community. The Transmitter is an online publication that aims to deliver...

Listen

Episode 0

January 29, 2025 01:37:37
Episode Cover

BI 204 David Robbe: Your Brain Doesn't Measure Time

Support the show to get full episodes, full archive, and join the Discord community. The Transmitter is an online publication that aims to deliver...

Listen

Episode 0

November 29, 2018 01:09:04
Episode Cover

BI 020 Anna Wexler: Stimulate Your Brain?

Show notes: Anna’s website: annawexler.com. Follow Anna on Twitter: @anna_wexler. Check out her documentary Unorthodox. The papers we discuss: Recurrent themes in the history...

Listen