BI 106 Jacqueline Gottlieb and Robert Wilson: Deep Curiosity

May 27, 2021 01:31:53
BI 106 Jacqueline Gottlieb and Robert Wilson: Deep Curiosity
Brain Inspired
BI 106 Jacqueline Gottlieb and Robert Wilson: Deep Curiosity

May 27 2021 | 01:31:53

/

Show Notes

Jackie and Bob discuss their research and thinking about curiosity.

Jackie’s background is studying decision making and attention, recording neurons in nonhuman primates during eye movement tasks, and she’s broadly interested in how we adapt our ongoing behavior. Curiosity is crucial for this, so she recently has focused on behavioral strategies to exercise curiosity, developing tasks that test exploration, information sampling, uncertainty reduction, and intrinsic motivation.

Bob’s background is developing computational models of reinforcement learning (including the exploration-exploitation tradeoff) and decision making, and he behavior and neuroimaging data in humans to test the models. He’s broadly interested in how and whether we can understand brains and cognition using mathematical models. Recently he’s been working on a model for curiosity known as deep exploration, which suggests we make decisions by deeply simulating a handful of scenarios and choosing based on the simulation outcomes.

We also discuss how one should go about their career (qua curiosity), how eye movements compare with other windows into cognition, and whether we can and should create curious AI agents (Bob is an emphatic yes, and Jackie is slightly worried that will be the time to worry about AI).

Timestamps:

0:00 – Intro
4:15 – Central scientific interests
8:32 – Advent of mathematical models
12:15 – Career exploration vs. exploitation
28:03 – Eye movements and active sensing
35:53 – Status of eye movements in neuroscience
44:16 – Why are we curious?
50:26 – Curiosity vs. Exploration vs. Intrinsic motivation
1:02:35 – Directed vs. random exploration
1:06:16 – Deep exploration
1:12:52 – How to know what to pay attention to
1:19:49 – Does AI need curiosity?
1:26:29 – What trait do you wish you had more of?

Other Episodes

Episode 0

January 19, 2022 01:11:05
Episode Cover

BI 125 Doris Tsao, Tony Zador, Blake Richards: NAISys

Support the show to get full episodes and join the Discord community. Doris, Tony, and Blake are the organizers for this year’s NAISys conference,...

Listen

Episode 0

October 14, 2023 01:23:57
Episode Cover

BI 176 David Poeppel Returns

Support the show to get full episodes and join the Discord community. David runs his lab at NYU, where they stud`y auditory cognition, speech...

Listen

Episode 0

September 30, 2020 01:43:41
Episode Cover

BI 085 Ida Momennejad: Learning Representations

Ida and I discuss the current landscape of reinforcement learning in both natural and artificial intelligence, and how the old story of two RL...

Listen