BI 052 Andrew Saxe: Deep Learning Theory

November 06, 2019 01:25:48
BI 052 Andrew Saxe: Deep Learning Theory
Brain Inspired
BI 052 Andrew Saxe: Deep Learning Theory

Nov 06 2019 | 01:25:48

/

Show Notes

Support the Podcast

Andrew and I discuss his work exploring how various facets of deep networks contribute to their function, i.e. deep network theory. We talk about what he’s learned by studying linear deep networks and asking how depth and initial weights affect learning dynamics, when replay is appropriate (and when it’s not), how semantics develop, and what it all might tell us about deep learning in brains.

Show notes:

A few recommended texts to dive deeper:

Other Episodes

Episode

June 29, 2019 01:19:09
Episode Cover

BI 039 Anne Churchland: Decisions, Lapses, and Fidgets

Art by Julia Kuhl: http://www.somedonkey.com/ Show notes: Check out Anne's lab website.Follow her on twitter: @anne_churchlandAnne's List, the list of female systems neuroscientists to...

Listen

Episode 0

September 08, 2019 01:37:12
Episode Cover

BI 046 David Poeppel: From Sounds to Meanings

Support the Podcast David and I talk about his work to understand how sound waves floating in the air get transformed into meaningful concepts...

Listen

Episode 0

December 11, 2023 01:29:27
Episode Cover

BI 180 Panel Discussion: Long-term Memory Encoding and Connectome Decoding

Support the show to get full episodes and join the Discord community. Welcome to another special panel discussion episode. I was recently invited to...

Listen