BI NMA 04: Deep Learning Basics Panel

August 06, 2021 00:59:21
BI NMA 04: Deep Learning Basics Panel
Brain Inspired
BI NMA 04: Deep Learning Basics Panel

Aug 06 2021 | 00:59:21

/

Show Notes

BI NMA 04:

Deep Learning Basics Panel

This is the 4th in a series of panel discussions in collaboration with Neuromatch Academy, the online computational neuroscience summer school. This is the first of 3 in the deep learning series. In this episode, the panelists discuss their experiences with some basics in deep learning, including Linear deep learning, Pytorch, multi-layer-perceptrons, optimization, & regularization.

Guests

The other panels:

  • First panel, about model fitting, GLMs/machine learning, dimensionality reduction, and deep learning.
  • Second panel, about linear systems, real neurons, and dynamic networks.
  • Third panel, about stochastic processes, including Bayes, decision-making, optimal control, reinforcement learning, and causality.
  • Fifth panel, about “doing more with fewer parameters: Convnets, RNNs, attention & transformers, generative models (VAEs & GANs).
  • Sixth panel, about advanced topics in deep learning: unsupervised & self-supervised learning, reinforcement learning, continual learning/causality.

 

Timestamps:

 

Other Episodes

Episode 0

November 15, 2018 01:06:03
Episode Cover

BI 018 Dean Buonomano: Time in Brains and AI

Show notes: Follow Dean on Twitter: @deanbuonoVisit his lab website at UCLA.The review we discuss: The Neural Basis of Timing: Distributed Mechanisms for Diverse...

Listen

Episode 0

September 10, 2025 01:25:05
Episode Cover

BI 220 Michael Breakspear and Mac Shine: Dynamic Systems from Neurons to Brains

Support the show to get full episodes, full archive, and join the Discord community. The Transmitter is an online publication that aims to deliver...

Listen

Episode 0

April 15, 2022 01:29:14
Episode Cover

BI 133 Ken Paller: Lucid Dreaming, Memory, and Sleep

Support the show to get full episodes and join the Discord community. Check out my short video series about what's missing in AI and...

Listen