BI 052 Andrew Saxe: Deep Learning Theory

November 06, 2019 01:25:48
BI 052 Andrew Saxe: Deep Learning Theory
Brain Inspired
BI 052 Andrew Saxe: Deep Learning Theory

Nov 06 2019 | 01:25:48

/

Show Notes

Support the Podcast

Andrew and I discuss his work exploring how various facets of deep networks contribute to their function, i.e. deep network theory. We talk about what he’s learned by studying linear deep networks and asking how depth and initial weights affect learning dynamics, when replay is appropriate (and when it’s not), how semantics develop, and what it all might tell us about deep learning in brains.

Show notes:

A few recommended texts to dive deeper:

Other Episodes

Episode 0

November 12, 2020 01:26:52
Episode Cover

BI 089 Matt Smith: Drifting Cognition

Matt and I discuss how cognition and behavior drifts over the course of minutes and hours, and how global brain activity drifts with it....

Listen

Episode 0

May 27, 2022 01:17:49
Episode Cover

BI 137 Brian Butterworth: Can Fish Count?

Check out my short video series about what's missing in AI and Neuroscience. Support the show to get full episodes and join the Discord...

Listen

Episode 0

August 28, 2024 01:30:34
Episode Cover

BI 192 Àlex Gómez-Marín: The Edges of Consciousness

Support the show to get full episodes and join the Discord community. Àlex Gómez-Marín heads The Behavior of Organisms Laboratory at the Institute of...

Listen