BI ViDA Panel Discussion: Deep RL and Dopamine

September 02, 2021 • 00:57:25
BI ViDA Panel Discussion: Deep RL and Dopamine
Brain Inspired
BI ViDA Panel Discussion: Deep RL and Dopamine

Sep 02 2021 | 00:57:25

/

Show Notes

[et_pb_section fb_built=”1″ admin_label=”Header” _builder_version=”4.9.2″ background_color=”#ad876d” background_enable_image=”off” parallax=”on” custom_padding=”0vw||0vw||true|false” custom_css_main_element=”.podcast .entry-title {||display: none;||}” background_size__hover=”cover” background_size__hover_enabled=”cover”][et_pb_row _builder_version=”4.9.2″ background_color=”#d5a570″ use_background_color_gradient=”on” background_color_gradient_start=”rgba(26,24,68,0)” background_color_gradient_end=”#231f20″ background_color_gradient_overlays_image=”on” background_enable_image=”off” background_position=”top_center” width=”100%” max_width=”100%” min_height=”940px” custom_margin=”||” custom_padding=”4vw|10%|4vw|10%|true|true” animation_style=”slide” animation_direction=”bottom” animation_intensity_slide=”1%” use_custom_width=”on” width_unit=”off” custom_width_percent=”100%”][et_pb_column type=”4_4″ _builder_version=”3.25″ custom_padding=”|||” custom_padding__hover=”|||”][et_pb_text _builder_version=”4.9.2″ text_font=”||||||||” text_font_size=”20px” text_line_height=”1.8em” header_font=”Lato|900|||||||” header_font_size=”56px” header_letter_spacing=”1px” header_line_height=”1.2em” header_4_font=”Raleway|||on|||||” header_4_font_size=”22px” header_4_letter_spacing=”4px” header_4_line_height=”1.6em” text_orientation=”center” background_layout=”dark” max_width=”800px” module_alignment=”center” text_font_size_tablet=”” text_font_size_phone=”14px” text_font_size_last_edited=”on|desktop” header_font_size_tablet=”62px” header_font_size_phone=”38px” header_font_size_last_edited=”on|phone”]

BI ViDA Panel:

Deep RL and Dopamine

[/et_pb_text][et_pb_post_title title=”off” meta=”off” _builder_version=”4.9.2″ meta_font=”|700|||||||” meta_text_color=”#fe4943″ text_orientation=”center”][/et_pb_post_title][et_pb_image src=”https://braininspired.co/wp-content/uploads/2018/10/[email protected]” title_text=”become_a_patron_button@2x” url=”https://www.patreon.com/braininspired” url_new_window=”on” align=”center” _builder_version=”4.9.2″ _module_preset=”default”][/et_pb_image][et_pb_text _builder_version=”4.9.2″ text_font=”||||||||” text_font_size=”20px” text_line_height=”1.8em” header_font=”Lato|900|||||||” header_font_size=”82px” header_letter_spacing=”1px” header_line_height=”1.2em” header_4_font=”Raleway|||on|||||” header_4_font_size=”22px” header_4_letter_spacing=”4px” header_4_line_height=”1.6em” text_orientation=”center” background_layout=”dark” max_width=”800px” module_alignment=”center” hover_enabled=”0″ text_font_size_tablet=”” text_font_size_phone=”14px” text_font_size_last_edited=”on|desktop” header_font_size_tablet=”62px” header_font_size_phone=”38px” header_font_size_last_edited=”on|phone” sticky_enabled=”0″]

This is a panel discussion at the Virtual Dopamine Conference 2021 (last episode Ali Mohebi and Ben Engelhard discussed dopamine more broadly).

Before the panel, Matt Botvinick gave a talk about how deep reinforcement learning is doing amazing things and helping drive our understanding of brain function.

[/et_pb_text][et_pb_image src=”https://braininspired.co/wp-content/uploads/2021/09/ViDA-artArtboard-3.png” _builder_version=”4.9.2″ _module_preset=”default” title_text=”ViDA artArtboard 3″ hover_enabled=”0″ sticky_enabled=”0″][/et_pb_image][et_pb_text _builder_version=”4.9.2″ _module_preset=”default” hover_enabled=”0″ sticky_enabled=”0″]

Different views on dopamine, deep RL, and the brain

by Daphne Cornelisse.

[/et_pb_text][et_pb_text _builder_version=”4.9.2″ _module_preset=”default” hover_enabled=”0″ sticky_enabled=”0″]
What can artificial intelligence teach us about how the brain uses dopamine to learn?
Recent advances in artificial intelligence have yielded novel algorithms for reinforcement learning (RL), which leverage the power of deep learning together with reward prediction error signals in order to achieve unprecedented performance in complex tasks. In the brain, reward prediction error signals are thought to be signaled by midbrain dopamine neurons and support learning. Can these new advances in Deep RL help us understand the role that dopamine plays in learning? In this panel experts in both theoretical and experimental dopamine research will discuss this question.
[/et_pb_text][/et_pb_column][/et_pb_row][/et_pb_section][et_pb_section fb_built=”1″ admin_label=”Episode Details” _builder_version=”4.9.2″ background_color=”#d5a570″ background_image=”https://braininspired.co/wp-content/uploads/2021/08/podcast-06.png” parallax=”on” custom_padding=”0px|||||” background_size__hover=”cover” background_size__hover_enabled=”cover”][et_pb_row _builder_version=”4.9.2″ custom_padding=”47px|||||” custom_width_px__hover=”1080px” custom_width_px__hover_enabled=”1080px” custom_width_percent__hover=”80%” custom_width_percent__hover_enabled=”80%” use_custom_width__hover=”off” use_custom_width__hover_enabled=”off” width_unit__hover=”on” width_unit__hover_enabled=”on” gutter_width__hover=”3″ gutter_width__hover_enabled=”3″ parallax_1__hover=”off” parallax_1__hover_enabled=”off” parallax_2__hover=”off” parallax_2__hover_enabled=”off” parallax_3__hover=”off” parallax_3__hover_enabled=”off” parallax_4__hover=”off” parallax_4__hover_enabled=”off” parallax_5__hover=”off” parallax_5__hover_enabled=”off” parallax_6__hover=”off” parallax_6__hover_enabled=”off” parallax_method_1__hover=”on” parallax_method_1__hover_enabled=”on” parallax_method_2__hover=”on” parallax_method_2__hover_enabled=”on” parallax_method_3__hover=”on” parallax_method_3__hover_enabled=”on” parallax_method_4__hover=”on” parallax_method_4__hover_enabled=”on” parallax_method_5__hover=”on” parallax_method_5__hover_enabled=”on” parallax_method_6__hover=”on” parallax_method_6__hover_enabled=”on” use_background_color_gradient__hover=”off” use_background_color_gradient__hover_enabled=”off” background_color_gradient_start__hover=”#2b87da” background_color_gradient_start__hover_enabled=”#2b87da” background_color_gradient_end__hover=”#29c4a9″ background_color_gradient_end__hover_enabled=”#29c4a9″ background_color_gradient_overlays_image__hover=”off” background_color_gradient_overlays_image__hover_enabled=”off” background_position__hover=”center” background_position__hover_enabled=”center” animation_style__hover=”none” animation_style__hover_enabled=”none” animation_direction__hover=”center” animation_direction__hover_enabled=”center” animation_intensity_slide__hover=”50%” animation_intensity_slide__hover_enabled=”50%” background_color_gradient_type__hover=”linear” background_color_gradient_type__hover_enabled=”linear” background_color_gradient_direction__hover=”180deg” background_color_gradient_direction__hover_enabled=”180deg” background_color_gradient_direction_radial__hover=”center” background_color_gradient_direction_radial__hover_enabled=”center” background_color_gradient_start_position__hover=”0%” background_color_gradient_start_position__hover_enabled=”0%” background_color_gradient_end_position__hover=”100%” background_color_gradient_end_position__hover_enabled=”100%” parallax__hover=”off” parallax__hover_enabled=”off” parallax_method__hover=”on” parallax_method__hover_enabled=”on” background_size__hover=”cover” background_size__hover_enabled=”cover” background_repeat__hover=”no-repeat” background_repeat__hover_enabled=”no-repeat” background_blend__hover=”normal” background_blend__hover_enabled=”normal” allow_player_pause__hover=”off” allow_player_pause__hover_enabled=”off” background_video_pause_outside_viewport__hover=”on” background_video_pause_outside_viewport__hover_enabled=”on” make_fullwidth__hover=”off” make_fullwidth__hover_enabled=”off” use_custom_gutter__hover=”off” use_custom_gutter__hover_enabled=”off” make_equal__hover=”off” make_equal__hover_enabled=”off” border_radii__hover=”on||||” border_radii__hover_enabled=”on||||” box_shadow_style__hover=”none” box_shadow_style__hover_enabled=”none” box_shadow_color__hover=”rgba(0,0,0,0.3)” box_shadow_color__hover_enabled=”rgba(0,0,0,0.3)” filter_hue_rotate__hover=”0deg” filter_hue_rotate__hover_enabled=”0deg” filter_saturate__hover=”100%” filter_saturate__hover_enabled=”100%” filter_brightness__hover=”100%” filter_brightness__hover_enabled=”100%” filter_contrast__hover=”100%” filter_contrast__hover_enabled=”100%” filter_invert__hover=”0%” filter_invert__hover_enabled=”0%” filter_sepia__hover=”0%” filter_sepia__hover_enabled=”0%” filter_opacity__hover=”100%” filter_opacity__hover_enabled=”100%” filter_blur__hover=”0px” filter_blur__hover_enabled=”0px” mix_blend_mode__hover=”normal” mix_blend_mode__hover_enabled=”normal” animation_repeat__hover=”once” animation_repeat__hover_enabled=”once” animation_duration__hover=”1000ms” animation_duration__hover_enabled=”1000ms” animation_delay__hover=”0ms” animation_delay__hover_enabled=”0ms” animation_intensity_zoom__hover=”50%” animation_intensity_zoom__hover_enabled=”50%” animation_intensity_flip__hover=”50%” animation_intensity_flip__hover_enabled=”50%” animation_intensity_fold__hover=”50%” animation_intensity_fold__hover_enabled=”50%” animation_intensity_roll__hover=”50%” animation_intensity_roll__hover_enabled=”50%” animation_starting_opacity__hover=”0%” animation_starting_opacity__hover_enabled=”0%” animation_speed_curve__hover=”ease-in-out” animation_speed_curve__hover_enabled=”ease-in-out” hover_transition_duration__hover=”300ms” hover_transition_duration__hover_enabled=”300ms” hover_transition_delay__hover=”0ms” hover_transition_delay__hover_enabled=”0ms” hover_transition_speed_curve__hover=”ease” hover_transition_speed_curve__hover_enabled=”ease”][et_pb_column type=”4_4″ _builder_version=”4.9.2″ _module_preset=”default”][et_pb_text _builder_version=”4.9.2″ text_text_color=”#0f1424″ text_line_height=”2em” link_font=”||||||||” link_text_color=”#0f1424″ header_text_color=”#0f1424″ header_2_text_color=”#0f1424″ header_3_text_color=”#0f1424″ header_4_text_color=”#0f1424″ hover_enabled=”0″ sticky_enabled=”0″]

Panel

[/et_pb_text][et_pb_text _builder_version=”4.9.2″ _module_preset=”default” hover_enabled=”0″ sticky_enabled=”0″]
Timestamps:
0:00 – Intro
4:45 – Armin Lak
6:50 – Ashok Litwin-Kumar
8:28 – Ilana Witten
10:15 – Ida Mommenejad
11:57 – Is reward enough?
14:56 – Can AI lead neuroscience astray?
25:45 – Other roles for dopamine
31:33 – Does structure matter?
44:30 – Non-brain-like solutions in AI
48:03 – What’s missing in deep RL for brains?

 

[/et_pb_text][/et_pb_column][/et_pb_row][/et_pb_section]

Other Episodes

Episode 0

October 02, 2021 • 01:23:41
Episode Cover

BI 115 Steve Grossberg: Conscious Mind, Resonant Brain

Support the show to get full episodes and join the Discord community Steve and I discuss his book Conscious Mind, Resonant Brain: How Each...

Listen

Episode 0

August 13, 2021 • 01:23:50
Episode Cover

BI NMA 05: NLP and Generative Models Panel

BI NMA 05: NLP and Generative Models Panel This is the 5th in a series of panel discussions in collaboration with Neuromatch Academy, the...

Listen

Episode 0

August 27, 2025 • 01:47:11
Episode Cover

BI 219 Xaq Pitkow: Principles and Constraints of Cognition

Support the show to get full episodes, full archive, and join the Discord community. The Transmitter is an online publication that aims to deliver...

Listen