BI 052 Andrew Saxe: Deep Learning Theory

November 06, 2019 01:25:48
BI 052 Andrew Saxe: Deep Learning Theory
Brain Inspired
BI 052 Andrew Saxe: Deep Learning Theory

Nov 06 2019 | 01:25:48

/

Show Notes

Support the Podcast

Andrew and I discuss his work exploring how various facets of deep networks contribute to their function, i.e. deep network theory. We talk about what he’s learned by studying linear deep networks and asking how depth and initial weights affect learning dynamics, when replay is appropriate (and when it’s not), how semantics develop, and what it all might tell us about deep learning in brains.

Show notes:

A few recommended texts to dive deeper:

Other Episodes

Episode 0

November 01, 2021 01:36:08
Episode Cover

BI 118 Johannes Jäger: Beyond Networks

Support the show to get full episodes and join the Discord community. Johannes (Yogi) is a freelance philosopher, researcher & educator. We discuss many...

Listen

Episode 0

January 30, 2019 01:22:30
Episode Cover

BI 026 Kendrick Kay: A Model By Any Other Name

Image courtesy of Kendrick Kay: Brain art Show notes: Check out Kendrick’s lab website: CVN lab. Follow him on twitter: @cvnlab. The papers we...

Listen

Episode 0

September 20, 2018 01:04:46
Episode Cover

BI 010 Adam Marblestone: Brain Cost Functions

  Mentioned in the show Adam’s Website. Follow him on Twitter. He made Technology Review’s 35 Innovators Under 35. The paper we discuss: Toward an...

Listen