BI NMA 05: NLP and Generative Models Panel

August 13, 2021 01:23:50
BI NMA 05: NLP and Generative Models Panel
Brain Inspired
BI NMA 05: NLP and Generative Models Panel

Aug 13 2021 | 01:23:50

/

Show Notes

BI NMA 05:

NLP and Generative Models Panel

This is the 5th in a series of panel discussions in collaboration with Neuromatch Academy, the online computational neuroscience summer school. This is the 2nd of 3 in the deep learning series. In this episode, the panelists discuss their experiences “doing more with fewer parameters: Convnets, RNNs, attention & transformers, generative models (VAEs & GANs).

Panelists

The other panels:

  • First panel, about model fitting, GLMs/machine learning, dimensionality reduction, and deep learning.
  • Second panel, about linear systems, real neurons, and dynamic networks.
  • Third panel, about stochastic processes, including Bayes, decision-making, optimal control, reinforcement learning, and causality.
  • Fourth panel, about some basics in deep learning, including Linear deep learning, Pytorch, multi-layer-perceptrons, optimization, & regularization.
  • Sixth panel, about advanced topics in deep learning: unsupervised & self-supervised learning, reinforcement learning, continual learning/causality.

Other Episodes

Episode 0

October 05, 2018 01:06:25
Episode Cover

BI 012 Niko Kriegeskorte: Black Box, White Box

Mentioned in the show: Follow Niko on twitter @KriegeskorteLab. Visit his lab website. The Cognitive Computational Neuroscience Conference. The review papers we base the...

Listen

Episode 0

July 22, 2021 01:00:48
Episode Cover

BI NMA 03: Stochastic Processes Panel

Panelists: Yael Niv.@yael_nivKonrad [email protected] BI episodes:BI 027 Ioana Marinescu & Konrad Kording: Causality in Quasi-Experiments.BI 014 Konrad Kording: Regulators, Mount Up!Sam [email protected] BI episodes:BI...

Listen

Episode 0

April 29, 2019 01:06:05
Episode Cover

BI 033 Federico Turkheimer: Weak Versus Strong Emergence

Show Notes: Federico’s website.Federico’s papers we discuss: Conflicting emergences. Weak vs. strong emergence for the modelling of brain functionFrom homeostasis to behavior: balanced activity...

Listen