BI NMA 04: Deep Learning Basics Panel

August 06, 2021 00:59:21
BI NMA 04: Deep Learning Basics Panel
Brain Inspired
BI NMA 04: Deep Learning Basics Panel

Aug 06 2021 | 00:59:21

/

Show Notes

BI NMA 04:

Deep Learning Basics Panel

This is the 4th in a series of panel discussions in collaboration with Neuromatch Academy, the online computational neuroscience summer school. This is the first of 3 in the deep learning series. In this episode, the panelists discuss their experiences with some basics in deep learning, including Linear deep learning, Pytorch, multi-layer-perceptrons, optimization, & regularization.

Guests

The other panels:

  • First panel, about model fitting, GLMs/machine learning, dimensionality reduction, and deep learning.
  • Second panel, about linear systems, real neurons, and dynamic networks.
  • Third panel, about stochastic processes, including Bayes, decision-making, optimal control, reinforcement learning, and causality.
  • Fifth panel, about “doing more with fewer parameters: Convnets, RNNs, attention & transformers, generative models (VAEs & GANs).
  • Sixth panel, about advanced topics in deep learning: unsupervised & self-supervised learning, reinforcement learning, continual learning/causality.

 

Timestamps:

 

Other Episodes

Episode

October 06, 2019 01:24:45
Episode Cover

BI 049 Phillip Alvelda: Trustworthy Brain Machines

Phillip and I discuss his company Brainworks, which uses the latest neuroscience to build AI into its products. We talk about their first product,...

Listen

Episode 0

August 02, 2018 00:45:39
Episode Cover

BI 005 David Sussillo: RNNs are Back!

Mentioned in the show: David’s Twitter account Papers we discuss: Sussillo, D.S. & Abbott, L. F. (2009). Generating Coherent Patterns of Activity from Chaotic...

Listen

Episode 0

February 11, 2019 01:20:04
Episode Cover

BI 027 Ioana Marinescu & Konrad Kording: Causality in Quasi-Experiments

Show notes: Websites: Ioana Marinescu, Konrad KordingTwitter: Twitter: @mioana; @KordingLabThe paper we discuss: Quasi-experimental causality in neuroscience and behavioral research.A Pre-print version. Judea Pearl’s...

Listen