BI 052 Andrew Saxe: Deep Learning Theory

November 06, 2019 • 01:25:48
BI 052 Andrew Saxe: Deep Learning Theory
Brain Inspired
BI 052 Andrew Saxe: Deep Learning Theory

Nov 06 2019 | 01:25:48

/

Show Notes

Support the Podcast

Andrew and I discuss his work exploring how various facets of deep networks contribute to their function, i.e. deep network theory. We talk about what he’s learned by studying linear deep networks and asking how depth and initial weights affect learning dynamics, when replay is appropriate (and when it’s not), how semantics develop, and what it all might tell us about deep learning in brains.

Show notes:

A few recommended texts to dive deeper:

Other Episodes

Episode 0

November 11, 2021 • 01:06:36
Episode Cover

BI 119 Henry Yin: The Crisis in Neuroscience

Support the show to get full episodes and join the Discord community. Henry and I discuss why he thinks neuroscience is in a crisis...

Listen

Episode 0

October 05, 2018 • 01:06:25
Episode Cover

BI 012 Niko Kriegeskorte: Black Box, White Box

Mentioned in the show: Follow Niko on twitter @KriegeskorteLab. Visit his lab website. The Cognitive Computational Neuroscience Conference. The review papers we base the...

Listen

Episode 0

January 30, 2019 • 01:22:30
Episode Cover

BI 026 Kendrick Kay: A Model By Any Other Name

Image courtesy of Kendrick Kay: Brain art Show notes: Check out Kendrick’s lab website: CVN lab. Follow him on twitter: @cvnlab. The papers we...

Listen