Support the Podcast
Andrew and I discuss his work exploring how various facets of deep networks contribute to their function, i.e. deep network theory. We talk about what he’s learned by studying linear deep networks and asking how depth and initial weights affect learning dynamics, when replay is appropriate (and when it’s not), how semantics develop, and what it all might tell us about deep learning in brains.
Show notes:
A few recommended texts to dive deeper:
Support the show to get full episodes and join the Discord community. Mac and I discuss his systems level approach to understanding brains, and...
Businessportrait Francisco Webber Cortical.ioThe white paper we discuss: Semantic Folding Theory And its Application in Semantic Fingerprinting. A nice talk Francisco gave: Semantic fingerprinting:...
BI 112: Ali Mohebi and Ben Engelhard The Many Faces of Dopamine Announcement: Ben has started his new lab and is recruiting grad students....