BI ViDA Panel Discussion: Deep RL and Dopamine

September 02, 2021 00:57:25
BI ViDA Panel Discussion: Deep RL and Dopamine
Brain Inspired
BI ViDA Panel Discussion: Deep RL and Dopamine

Sep 02 2021 | 00:57:25

/

Show Notes

[et_pb_section fb_built=”1″ admin_label=”Header” _builder_version=”4.9.2″ background_color=”#ad876d” background_enable_image=”off” parallax=”on” custom_padding=”0vw||0vw||true|false” custom_css_main_element=”.podcast .entry-title {||display: none;||}” background_size__hover=”cover” background_size__hover_enabled=”cover”][et_pb_row _builder_version=”4.9.2″ background_color=”#d5a570″ use_background_color_gradient=”on” background_color_gradient_start=”rgba(26,24,68,0)” background_color_gradient_end=”#231f20″ background_color_gradient_overlays_image=”on” background_enable_image=”off” background_position=”top_center” width=”100%” max_width=”100%” min_height=”940px” custom_margin=”||” custom_padding=”4vw|10%|4vw|10%|true|true” animation_style=”slide” animation_direction=”bottom” animation_intensity_slide=”1%” use_custom_width=”on” width_unit=”off” custom_width_percent=”100%”][et_pb_column type=”4_4″ _builder_version=”3.25″ custom_padding=”|||” custom_padding__hover=”|||”][et_pb_text _builder_version=”4.9.2″ text_font=”||||||||” text_font_size=”20px” text_line_height=”1.8em” header_font=”Lato|900|||||||” header_font_size=”56px” header_letter_spacing=”1px” header_line_height=”1.2em” header_4_font=”Raleway|||on|||||” header_4_font_size=”22px” header_4_letter_spacing=”4px” header_4_line_height=”1.6em” text_orientation=”center” background_layout=”dark” max_width=”800px” module_alignment=”center” text_font_size_tablet=”” text_font_size_phone=”14px” text_font_size_last_edited=”on|desktop” header_font_size_tablet=”62px” header_font_size_phone=”38px” header_font_size_last_edited=”on|phone”]

BI ViDA Panel:

Deep RL and Dopamine

[/et_pb_text][et_pb_post_title title=”off” meta=”off” _builder_version=”4.9.2″ meta_font=”|700|||||||” meta_text_color=”#fe4943″ text_orientation=”center”][/et_pb_post_title][et_pb_image src=”https://braininspired.co/wp-content/uploads/2018/10/[email protected]” title_text=”become_a_patron_button@2x” url=”https://www.patreon.com/braininspired” url_new_window=”on” align=”center” _builder_version=”4.9.2″ _module_preset=”default”][/et_pb_image][et_pb_text _builder_version=”4.9.2″ text_font=”||||||||” text_font_size=”20px” text_line_height=”1.8em” header_font=”Lato|900|||||||” header_font_size=”82px” header_letter_spacing=”1px” header_line_height=”1.2em” header_4_font=”Raleway|||on|||||” header_4_font_size=”22px” header_4_letter_spacing=”4px” header_4_line_height=”1.6em” text_orientation=”center” background_layout=”dark” max_width=”800px” module_alignment=”center” hover_enabled=”0″ text_font_size_tablet=”” text_font_size_phone=”14px” text_font_size_last_edited=”on|desktop” header_font_size_tablet=”62px” header_font_size_phone=”38px” header_font_size_last_edited=”on|phone” sticky_enabled=”0″]

This is a panel discussion at the Virtual Dopamine Conference 2021 (last episode Ali Mohebi and Ben Engelhard discussed dopamine more broadly).

Before the panel, Matt Botvinick gave a talk about how deep reinforcement learning is doing amazing things and helping drive our understanding of brain function.

[/et_pb_text][et_pb_image src=”https://braininspired.co/wp-content/uploads/2021/09/ViDA-artArtboard-3.png” _builder_version=”4.9.2″ _module_preset=”default” title_text=”ViDA artArtboard 3″ hover_enabled=”0″ sticky_enabled=”0″][/et_pb_image][et_pb_text _builder_version=”4.9.2″ _module_preset=”default” hover_enabled=”0″ sticky_enabled=”0″]

Different views on dopamine, deep RL, and the brain

by Daphne Cornelisse.

[/et_pb_text][et_pb_text _builder_version=”4.9.2″ _module_preset=”default” hover_enabled=”0″ sticky_enabled=”0″]
What can artificial intelligence teach us about how the brain uses dopamine to learn?
Recent advances in artificial intelligence have yielded novel algorithms for reinforcement learning (RL), which leverage the power of deep learning together with reward prediction error signals in order to achieve unprecedented performance in complex tasks. In the brain, reward prediction error signals are thought to be signaled by midbrain dopamine neurons and support learning. Can these new advances in Deep RL help us understand the role that dopamine plays in learning? In this panel experts in both theoretical and experimental dopamine research will discuss this question.
[/et_pb_text][/et_pb_column][/et_pb_row][/et_pb_section][et_pb_section fb_built=”1″ admin_label=”Episode Details” _builder_version=”4.9.2″ background_color=”#d5a570″ background_image=”https://braininspired.co/wp-content/uploads/2021/08/podcast-06.png” parallax=”on” custom_padding=”0px|||||” background_size__hover=”cover” background_size__hover_enabled=”cover”][et_pb_row _builder_version=”4.9.2″ custom_padding=”47px|||||” custom_width_px__hover=”1080px” custom_width_px__hover_enabled=”1080px” custom_width_percent__hover=”80%” custom_width_percent__hover_enabled=”80%” use_custom_width__hover=”off” use_custom_width__hover_enabled=”off” width_unit__hover=”on” width_unit__hover_enabled=”on” gutter_width__hover=”3″ gutter_width__hover_enabled=”3″ parallax_1__hover=”off” parallax_1__hover_enabled=”off” parallax_2__hover=”off” parallax_2__hover_enabled=”off” parallax_3__hover=”off” parallax_3__hover_enabled=”off” parallax_4__hover=”off” parallax_4__hover_enabled=”off” parallax_5__hover=”off” parallax_5__hover_enabled=”off” parallax_6__hover=”off” parallax_6__hover_enabled=”off” parallax_method_1__hover=”on” parallax_method_1__hover_enabled=”on” parallax_method_2__hover=”on” parallax_method_2__hover_enabled=”on” parallax_method_3__hover=”on” parallax_method_3__hover_enabled=”on” parallax_method_4__hover=”on” parallax_method_4__hover_enabled=”on” parallax_method_5__hover=”on” parallax_method_5__hover_enabled=”on” parallax_method_6__hover=”on” parallax_method_6__hover_enabled=”on” use_background_color_gradient__hover=”off” use_background_color_gradient__hover_enabled=”off” background_color_gradient_start__hover=”#2b87da” background_color_gradient_start__hover_enabled=”#2b87da” background_color_gradient_end__hover=”#29c4a9″ background_color_gradient_end__hover_enabled=”#29c4a9″ background_color_gradient_overlays_image__hover=”off” background_color_gradient_overlays_image__hover_enabled=”off” background_position__hover=”center” background_position__hover_enabled=”center” animation_style__hover=”none” animation_style__hover_enabled=”none” animation_direction__hover=”center” animation_direction__hover_enabled=”center” animation_intensity_slide__hover=”50%” animation_intensity_slide__hover_enabled=”50%” background_color_gradient_type__hover=”linear” background_color_gradient_type__hover_enabled=”linear” background_color_gradient_direction__hover=”180deg” background_color_gradient_direction__hover_enabled=”180deg” background_color_gradient_direction_radial__hover=”center” background_color_gradient_direction_radial__hover_enabled=”center” background_color_gradient_start_position__hover=”0%” background_color_gradient_start_position__hover_enabled=”0%” background_color_gradient_end_position__hover=”100%” background_color_gradient_end_position__hover_enabled=”100%” parallax__hover=”off” parallax__hover_enabled=”off” parallax_method__hover=”on” parallax_method__hover_enabled=”on” background_size__hover=”cover” background_size__hover_enabled=”cover” background_repeat__hover=”no-repeat” background_repeat__hover_enabled=”no-repeat” background_blend__hover=”normal” background_blend__hover_enabled=”normal” allow_player_pause__hover=”off” allow_player_pause__hover_enabled=”off” background_video_pause_outside_viewport__hover=”on” background_video_pause_outside_viewport__hover_enabled=”on” make_fullwidth__hover=”off” make_fullwidth__hover_enabled=”off” use_custom_gutter__hover=”off” use_custom_gutter__hover_enabled=”off” make_equal__hover=”off” make_equal__hover_enabled=”off” border_radii__hover=”on||||” border_radii__hover_enabled=”on||||” box_shadow_style__hover=”none” box_shadow_style__hover_enabled=”none” box_shadow_color__hover=”rgba(0,0,0,0.3)” box_shadow_color__hover_enabled=”rgba(0,0,0,0.3)” filter_hue_rotate__hover=”0deg” filter_hue_rotate__hover_enabled=”0deg” filter_saturate__hover=”100%” filter_saturate__hover_enabled=”100%” filter_brightness__hover=”100%” filter_brightness__hover_enabled=”100%” filter_contrast__hover=”100%” filter_contrast__hover_enabled=”100%” filter_invert__hover=”0%” filter_invert__hover_enabled=”0%” filter_sepia__hover=”0%” filter_sepia__hover_enabled=”0%” filter_opacity__hover=”100%” filter_opacity__hover_enabled=”100%” filter_blur__hover=”0px” filter_blur__hover_enabled=”0px” mix_blend_mode__hover=”normal” mix_blend_mode__hover_enabled=”normal” animation_repeat__hover=”once” animation_repeat__hover_enabled=”once” animation_duration__hover=”1000ms” animation_duration__hover_enabled=”1000ms” animation_delay__hover=”0ms” animation_delay__hover_enabled=”0ms” animation_intensity_zoom__hover=”50%” animation_intensity_zoom__hover_enabled=”50%” animation_intensity_flip__hover=”50%” animation_intensity_flip__hover_enabled=”50%” animation_intensity_fold__hover=”50%” animation_intensity_fold__hover_enabled=”50%” animation_intensity_roll__hover=”50%” animation_intensity_roll__hover_enabled=”50%” animation_starting_opacity__hover=”0%” animation_starting_opacity__hover_enabled=”0%” animation_speed_curve__hover=”ease-in-out” animation_speed_curve__hover_enabled=”ease-in-out” hover_transition_duration__hover=”300ms” hover_transition_duration__hover_enabled=”300ms” hover_transition_delay__hover=”0ms” hover_transition_delay__hover_enabled=”0ms” hover_transition_speed_curve__hover=”ease” hover_transition_speed_curve__hover_enabled=”ease”][et_pb_column type=”4_4″ _builder_version=”4.9.2″ _module_preset=”default”][et_pb_text _builder_version=”4.9.2″ text_text_color=”#0f1424″ text_line_height=”2em” link_font=”||||||||” link_text_color=”#0f1424″ header_text_color=”#0f1424″ header_2_text_color=”#0f1424″ header_3_text_color=”#0f1424″ header_4_text_color=”#0f1424″ hover_enabled=”0″ sticky_enabled=”0″]

Panel

[/et_pb_text][et_pb_text _builder_version=”4.9.2″ _module_preset=”default” hover_enabled=”0″ sticky_enabled=”0″]
Timestamps:
0:00 – Intro
4:45 – Armin Lak
6:50 – Ashok Litwin-Kumar
8:28 – Ilana Witten
10:15 – Ida Mommenejad
11:57 – Is reward enough?
14:56 – Can AI lead neuroscience astray?
25:45 – Other roles for dopamine
31:33 – Does structure matter?
44:30 – Non-brain-like solutions in AI
48:03 – What’s missing in deep RL for brains?

 

[/et_pb_text][/et_pb_column][/et_pb_row][/et_pb_section]

Other Episodes

Episode 0

October 25, 2018 00:49:34
Episode Cover

BI 015 Terrence Sejnowski: How to Start a Deep Learning Revolution

Show notes: His new book, The Deep Learning Revolution: His Computational Neurobiology Laboratory at the Salk Institute. His faculty page at UCSD. His first...

Listen

Episode 0

November 08, 2018 00:57:14
Episode Cover

BI 017 Jeff Hawkins: Location, Location, Location

  Follow Jeff and Numenta on twitter: @JeffCHawkins and @Numenta. The Numenta website- access all the previous papers leading up to this point. The paper...

Listen

Episode 0

April 15, 2022 01:29:14
Episode Cover

BI 133 Ken Paller: Lucid Dreaming, Memory, and Sleep

Support the show to get full episodes and join the Discord community. Check out my short video series about what's missing in AI and...

Listen