BI 052 Andrew Saxe: Deep Learning Theory

November 06, 2019 01:25:48
BI 052 Andrew Saxe: Deep Learning Theory
Brain Inspired
BI 052 Andrew Saxe: Deep Learning Theory

Nov 06 2019 | 01:25:48

/

Show Notes

Support the Podcast

Andrew and I discuss his work exploring how various facets of deep networks contribute to their function, i.e. deep network theory. We talk about what he’s learned by studying linear deep networks and asking how depth and initial weights affect learning dynamics, when replay is appropriate (and when it’s not), how semantics develop, and what it all might tell us about deep learning in brains.

Show notes:

A few recommended texts to dive deeper:

Other Episodes

Episode 0

August 19, 2021 01:20:32
Episode Cover

BI NMA 06: Advancing Neuro Deep Learning Panel

This is the 6th in a series of panel discussions in collaboration with Neuromatch Academy, the online computational neuroscience summer school. This is the...

Listen

Episode 0

December 23, 2022 01:40:45
Episode Cover

BI 156 Mariam Aly: Memory, Attention, and Perception

Support the show to get full episodes and join the Discord community. Check out my free video series about what's missing in AI and...

Listen

Episode

May 30, 2019 01:11:08
Episode Cover

BI 036 Roshan Cools: Cognitive Control and Dopamine

Show notes: Roshan will deliver a keynote address at the upcoming CCN conference.Roshan's Motivational and Cognitive Control lab.Follow her on Twitter: @CoolsControl.Her TED Talk...

Listen