BI 052 Andrew Saxe: Deep Learning Theory

November 06, 2019 01:25:48
BI 052 Andrew Saxe: Deep Learning Theory
Brain Inspired
BI 052 Andrew Saxe: Deep Learning Theory

Nov 06 2019 | 01:25:48

/

Show Notes

Support the Podcast

Andrew and I discuss his work exploring how various facets of deep networks contribute to their function, i.e. deep network theory. We talk about what he’s learned by studying linear deep networks and asking how depth and initial weights affect learning dynamics, when replay is appropriate (and when it’s not), how semantics develop, and what it all might tell us about deep learning in brains.

Show notes:

A few recommended texts to dive deeper:

Other Episodes

Episode 0

October 30, 2023 01:13:54
Episode Cover

BI 177 Special: Bernstein Workshop Panel

Support the show to get full episodes and join the Discord community. I was recently invited to moderate a panel at the Annual Bernstein...

Listen

Episode 0

August 07, 2023 01:30:58
Episode Cover

BI 172 David Glanzman: Memory All The Way Down

Support the show to get full episodes and join the Discord community. David runs his lab at UCLA where he's also a distinguished professor. ...

Listen

Episode 0

July 22, 2021 01:00:48
Episode Cover

BI NMA 03: Stochastic Processes Panel

Panelists: Yael Niv.@yael_nivKonrad [email protected] BI episodes:BI 027 Ioana Marinescu & Konrad Kording: Causality in Quasi-Experiments.BI 014 Konrad Kording: Regulators, Mount Up!Sam [email protected] BI episodes:BI...

Listen