BI ViDA Panel Discussion: Deep RL and Dopamine

September 02, 2021 00:57:25
BI ViDA Panel Discussion: Deep RL and Dopamine
Brain Inspired
BI ViDA Panel Discussion: Deep RL and Dopamine

Sep 02 2021 | 00:57:25

/

Show Notes

[et_pb_section fb_built=”1″ admin_label=”Header” _builder_version=”4.9.2″ background_color=”#ad876d” background_enable_image=”off” parallax=”on” custom_padding=”0vw||0vw||true|false” custom_css_main_element=”.podcast .entry-title {||display: none;||}” background_size__hover=”cover” background_size__hover_enabled=”cover”][et_pb_row _builder_version=”4.9.2″ background_color=”#d5a570″ use_background_color_gradient=”on” background_color_gradient_start=”rgba(26,24,68,0)” background_color_gradient_end=”#231f20″ background_color_gradient_overlays_image=”on” background_enable_image=”off” background_position=”top_center” width=”100%” max_width=”100%” min_height=”940px” custom_margin=”||” custom_padding=”4vw|10%|4vw|10%|true|true” animation_style=”slide” animation_direction=”bottom” animation_intensity_slide=”1%” use_custom_width=”on” width_unit=”off” custom_width_percent=”100%”][et_pb_column type=”4_4″ _builder_version=”3.25″ custom_padding=”|||” custom_padding__hover=”|||”][et_pb_text _builder_version=”4.9.2″ text_font=”||||||||” text_font_size=”20px” text_line_height=”1.8em” header_font=”Lato|900|||||||” header_font_size=”56px” header_letter_spacing=”1px” header_line_height=”1.2em” header_4_font=”Raleway|||on|||||” header_4_font_size=”22px” header_4_letter_spacing=”4px” header_4_line_height=”1.6em” text_orientation=”center” background_layout=”dark” max_width=”800px” module_alignment=”center” text_font_size_tablet=”” text_font_size_phone=”14px” text_font_size_last_edited=”on|desktop” header_font_size_tablet=”62px” header_font_size_phone=”38px” header_font_size_last_edited=”on|phone”]

BI ViDA Panel:

Deep RL and Dopamine

[/et_pb_text][et_pb_post_title title=”off” meta=”off” _builder_version=”4.9.2″ meta_font=”|700|||||||” meta_text_color=”#fe4943″ text_orientation=”center”][/et_pb_post_title][et_pb_image src=”https://braininspired.co/wp-content/uploads/2018/10/[email protected]” title_text=”become_a_patron_button@2x” url=”https://www.patreon.com/braininspired” url_new_window=”on” align=”center” _builder_version=”4.9.2″ _module_preset=”default”][/et_pb_image][et_pb_text _builder_version=”4.9.2″ text_font=”||||||||” text_font_size=”20px” text_line_height=”1.8em” header_font=”Lato|900|||||||” header_font_size=”82px” header_letter_spacing=”1px” header_line_height=”1.2em” header_4_font=”Raleway|||on|||||” header_4_font_size=”22px” header_4_letter_spacing=”4px” header_4_line_height=”1.6em” text_orientation=”center” background_layout=”dark” max_width=”800px” module_alignment=”center” hover_enabled=”0″ text_font_size_tablet=”” text_font_size_phone=”14px” text_font_size_last_edited=”on|desktop” header_font_size_tablet=”62px” header_font_size_phone=”38px” header_font_size_last_edited=”on|phone” sticky_enabled=”0″]

This is a panel discussion at the Virtual Dopamine Conference 2021 (last episode Ali Mohebi and Ben Engelhard discussed dopamine more broadly).

Before the panel, Matt Botvinick gave a talk about how deep reinforcement learning is doing amazing things and helping drive our understanding of brain function.

[/et_pb_text][et_pb_image src=”https://braininspired.co/wp-content/uploads/2021/09/ViDA-artArtboard-3.png” _builder_version=”4.9.2″ _module_preset=”default” title_text=”ViDA artArtboard 3″ hover_enabled=”0″ sticky_enabled=”0″][/et_pb_image][et_pb_text _builder_version=”4.9.2″ _module_preset=”default” hover_enabled=”0″ sticky_enabled=”0″]

Different views on dopamine, deep RL, and the brain

by Daphne Cornelisse.

[/et_pb_text][et_pb_text _builder_version=”4.9.2″ _module_preset=”default” hover_enabled=”0″ sticky_enabled=”0″]
What can artificial intelligence teach us about how the brain uses dopamine to learn?
Recent advances in artificial intelligence have yielded novel algorithms for reinforcement learning (RL), which leverage the power of deep learning together with reward prediction error signals in order to achieve unprecedented performance in complex tasks. In the brain, reward prediction error signals are thought to be signaled by midbrain dopamine neurons and support learning. Can these new advances in Deep RL help us understand the role that dopamine plays in learning? In this panel experts in both theoretical and experimental dopamine research will discuss this question.
[/et_pb_text][/et_pb_column][/et_pb_row][/et_pb_section][et_pb_section fb_built=”1″ admin_label=”Episode Details” _builder_version=”4.9.2″ background_color=”#d5a570″ background_image=”https://braininspired.co/wp-content/uploads/2021/08/podcast-06.png” parallax=”on” custom_padding=”0px|||||” background_size__hover=”cover” background_size__hover_enabled=”cover”][et_pb_row _builder_version=”4.9.2″ custom_padding=”47px|||||” custom_width_px__hover=”1080px” custom_width_px__hover_enabled=”1080px” custom_width_percent__hover=”80%” custom_width_percent__hover_enabled=”80%” use_custom_width__hover=”off” use_custom_width__hover_enabled=”off” width_unit__hover=”on” width_unit__hover_enabled=”on” gutter_width__hover=”3″ gutter_width__hover_enabled=”3″ parallax_1__hover=”off” parallax_1__hover_enabled=”off” parallax_2__hover=”off” parallax_2__hover_enabled=”off” parallax_3__hover=”off” parallax_3__hover_enabled=”off” parallax_4__hover=”off” parallax_4__hover_enabled=”off” parallax_5__hover=”off” parallax_5__hover_enabled=”off” parallax_6__hover=”off” parallax_6__hover_enabled=”off” parallax_method_1__hover=”on” parallax_method_1__hover_enabled=”on” parallax_method_2__hover=”on” parallax_method_2__hover_enabled=”on” parallax_method_3__hover=”on” parallax_method_3__hover_enabled=”on” parallax_method_4__hover=”on” parallax_method_4__hover_enabled=”on” parallax_method_5__hover=”on” parallax_method_5__hover_enabled=”on” parallax_method_6__hover=”on” parallax_method_6__hover_enabled=”on” use_background_color_gradient__hover=”off” use_background_color_gradient__hover_enabled=”off” background_color_gradient_start__hover=”#2b87da” background_color_gradient_start__hover_enabled=”#2b87da” background_color_gradient_end__hover=”#29c4a9″ background_color_gradient_end__hover_enabled=”#29c4a9″ background_color_gradient_overlays_image__hover=”off” background_color_gradient_overlays_image__hover_enabled=”off” background_position__hover=”center” background_position__hover_enabled=”center” animation_style__hover=”none” animation_style__hover_enabled=”none” animation_direction__hover=”center” animation_direction__hover_enabled=”center” animation_intensity_slide__hover=”50%” animation_intensity_slide__hover_enabled=”50%” background_color_gradient_type__hover=”linear” background_color_gradient_type__hover_enabled=”linear” background_color_gradient_direction__hover=”180deg” background_color_gradient_direction__hover_enabled=”180deg” background_color_gradient_direction_radial__hover=”center” background_color_gradient_direction_radial__hover_enabled=”center” background_color_gradient_start_position__hover=”0%” background_color_gradient_start_position__hover_enabled=”0%” background_color_gradient_end_position__hover=”100%” background_color_gradient_end_position__hover_enabled=”100%” parallax__hover=”off” parallax__hover_enabled=”off” parallax_method__hover=”on” parallax_method__hover_enabled=”on” background_size__hover=”cover” background_size__hover_enabled=”cover” background_repeat__hover=”no-repeat” background_repeat__hover_enabled=”no-repeat” background_blend__hover=”normal” background_blend__hover_enabled=”normal” allow_player_pause__hover=”off” allow_player_pause__hover_enabled=”off” background_video_pause_outside_viewport__hover=”on” background_video_pause_outside_viewport__hover_enabled=”on” make_fullwidth__hover=”off” make_fullwidth__hover_enabled=”off” use_custom_gutter__hover=”off” use_custom_gutter__hover_enabled=”off” make_equal__hover=”off” make_equal__hover_enabled=”off” border_radii__hover=”on||||” border_radii__hover_enabled=”on||||” box_shadow_style__hover=”none” box_shadow_style__hover_enabled=”none” box_shadow_color__hover=”rgba(0,0,0,0.3)” box_shadow_color__hover_enabled=”rgba(0,0,0,0.3)” filter_hue_rotate__hover=”0deg” filter_hue_rotate__hover_enabled=”0deg” filter_saturate__hover=”100%” filter_saturate__hover_enabled=”100%” filter_brightness__hover=”100%” filter_brightness__hover_enabled=”100%” filter_contrast__hover=”100%” filter_contrast__hover_enabled=”100%” filter_invert__hover=”0%” filter_invert__hover_enabled=”0%” filter_sepia__hover=”0%” filter_sepia__hover_enabled=”0%” filter_opacity__hover=”100%” filter_opacity__hover_enabled=”100%” filter_blur__hover=”0px” filter_blur__hover_enabled=”0px” mix_blend_mode__hover=”normal” mix_blend_mode__hover_enabled=”normal” animation_repeat__hover=”once” animation_repeat__hover_enabled=”once” animation_duration__hover=”1000ms” animation_duration__hover_enabled=”1000ms” animation_delay__hover=”0ms” animation_delay__hover_enabled=”0ms” animation_intensity_zoom__hover=”50%” animation_intensity_zoom__hover_enabled=”50%” animation_intensity_flip__hover=”50%” animation_intensity_flip__hover_enabled=”50%” animation_intensity_fold__hover=”50%” animation_intensity_fold__hover_enabled=”50%” animation_intensity_roll__hover=”50%” animation_intensity_roll__hover_enabled=”50%” animation_starting_opacity__hover=”0%” animation_starting_opacity__hover_enabled=”0%” animation_speed_curve__hover=”ease-in-out” animation_speed_curve__hover_enabled=”ease-in-out” hover_transition_duration__hover=”300ms” hover_transition_duration__hover_enabled=”300ms” hover_transition_delay__hover=”0ms” hover_transition_delay__hover_enabled=”0ms” hover_transition_speed_curve__hover=”ease” hover_transition_speed_curve__hover_enabled=”ease”][et_pb_column type=”4_4″ _builder_version=”4.9.2″ _module_preset=”default”][et_pb_text _builder_version=”4.9.2″ text_text_color=”#0f1424″ text_line_height=”2em” link_font=”||||||||” link_text_color=”#0f1424″ header_text_color=”#0f1424″ header_2_text_color=”#0f1424″ header_3_text_color=”#0f1424″ header_4_text_color=”#0f1424″ hover_enabled=”0″ sticky_enabled=”0″]

Panel

[/et_pb_text][et_pb_text _builder_version=”4.9.2″ _module_preset=”default” hover_enabled=”0″ sticky_enabled=”0″]
Timestamps:
0:00 – Intro
4:45 – Armin Lak
6:50 – Ashok Litwin-Kumar
8:28 – Ilana Witten
10:15 – Ida Mommenejad
11:57 – Is reward enough?
14:56 – Can AI lead neuroscience astray?
25:45 – Other roles for dopamine
31:33 – Does structure matter?
44:30 – Non-brain-like solutions in AI
48:03 – What’s missing in deep RL for brains?

 

[/et_pb_text][/et_pb_column][/et_pb_row][/et_pb_section]

Other Episodes

Episode 0

March 06, 2019 01:44:23
Episode Cover

BI 029 Paul Humphreys & Zac Irving: Emergence & Mind Wandering

Show notes: Paul Humphreys’ website.Zac Irving’s website.Emergence: Emergence: A Philosophical Account. (book by Paul)The Oxford Handbook of Philosophy of Science. Mind Wandering: Mind-Wandering is...

Listen

Episode 0

November 08, 2022 01:45:11
Episode Cover

BI 152 Michael L. Anderson: After Phrenology: Neural Reuse

Check out my free video series about what's missing in AI and Neuroscience Support the show to get full episodes and join the Discord...

Listen

Episode 0

May 17, 2022 01:34:12
Episode Cover

BI 136 Michel Bitbol and Alex Gomez-Marin: Phenomenology

Support the show to get full episodes and join the Discord community. Check out my short video series about what's missing in AI and...

Listen