BI NMA 05: NLP and Generative Models Panel

August 13, 2021 01:23:50
BI NMA 05: NLP and Generative Models Panel
Brain Inspired
BI NMA 05: NLP and Generative Models Panel

Aug 13 2021 | 01:23:50

/

Show Notes

BI NMA 05:

NLP and Generative Models Panel

This is the 5th in a series of panel discussions in collaboration with Neuromatch Academy, the online computational neuroscience summer school. This is the 2nd of 3 in the deep learning series. In this episode, the panelists discuss their experiences “doing more with fewer parameters: Convnets, RNNs, attention & transformers, generative models (VAEs & GANs).

Panelists

The other panels:

  • First panel, about model fitting, GLMs/machine learning, dimensionality reduction, and deep learning.
  • Second panel, about linear systems, real neurons, and dynamic networks.
  • Third panel, about stochastic processes, including Bayes, decision-making, optimal control, reinforcement learning, and causality.
  • Fourth panel, about some basics in deep learning, including Linear deep learning, Pytorch, multi-layer-perceptrons, optimization, & regularization.
  • Sixth panel, about advanced topics in deep learning: unsupervised & self-supervised learning, reinforcement learning, continual learning/causality.

Other Episodes

Episode 0

December 18, 2024 01:37:22
Episode Cover

BI 201 Rajesh Rao: From Predictive Coding to Brain Co-Processors

Support the show to get full episodes, full archive, and join the Discord community. Today I'm in conversation with Rajesh Rao, a distinguished professor...

Listen

Episode 0

May 21, 2025 01:33:34
Episode Cover

BI 212 John Beggs: Why Brains Seek the Edge of Chaos

Support the show to get full episodes, full archive, and join the Discord community. The Transmitter is an online publication that aims to deliver...

Listen

Episode 0

September 25, 2019 01:24:37
Episode Cover

BI 048 Liz Spelke: What Makes Us Special?

Jussi Puikkonen/KNAW Liz and I discuss her work on cognitive development, specially in infants, and what it can tell us about what makes human...

Listen