Brian and I discuss a range of topics related to his latest book, The Alignment Problem: Machine Learning and Human Values. The alignment problem asks how we can build AI that does what we want it to do, as opposed to building AI that will compromise our own values by accomplishing tasks that may be harmful or dangerous to us. Using some of the stories Brain relates in the book, we talk about:
Links:
Timestamps:
4:22 – Increased work on AI ethics
8:59 – The Alignment Problem overview
12:36 – Stories as important for intelligence
16:50 – What is the alignment problem
17:37 – Who works on the alignment problem?
25:22 – AI ethics degree?
29:03 – Human values
31:33 – AI alignment and evolution
37:10 – Knowing our own values?
46:27 – What have learned about ourselves?
58:51 – Interestingness
1:00:53 – Inverse RL for value alignment
1:04:50 – Current progress
1:10:08 – Developmental psychology
1:17:36 – Models as the danger
1:25:08 – How worried are the experts?
BI 112: Ali Mohebi and Ben Engelhard The Many Faces of Dopamine Announcement: Ben has started his new lab and is recruiting grad students....
Alison and I discuss her work to accelerate learning and thus improve AI by studying how children learn, as Alan Turing suggested in his...
Ken and I discuss open-endedness, the pursuit of ambitious goals by seeking novelty and interesting products instead of advancing directly toward defined objectives. We...