AI ALIGNMENT FORUM
AF

2021 MIRI Conversations

Nov 15, 2021 by Rob Bensinger

This sequence is a (chronological) series of chatroom conversation logs about artificial general intelligence. A large number of topics are covered, beginning with conversations related to alignment difficulty.

Short summaries of each post, and links to audio versions, are available here. There are also two related posts released shortly before this sequence:

  • Discussion with Eliezer Yudkowsky on AGI Interventions
  • Comments [by Nate Soares] on Joe Carlsmith's "Is power-seeking AI an existential risk?"

Rob Bensinger edited and posted this sequence, and Matthew Graves helped with much of the formatting.

⠀

Part One   (Primarily Richard Ngo and Eliezer Yudkowsky)

86Ngo and Yudkowsky on alignment difficulty
Eliezer Yudkowsky, Richard Ngo
4y
53
49Ngo and Yudkowsky on AI capability gains
Eliezer Yudkowsky, Richard Ngo
4y
46
69Yudkowsky and Christiano discuss "Takeoff Speeds"
Eliezer Yudkowsky
4y
97
37Soares, Tallinn, and Yudkowsky discuss AGI cognition
Nate Soares, Eliezer Yudkowsky, jaan
4y
24

Part Two   (Primarily Paul Christiano and Eliezer Yudkowsky)

42Christiano, Cotra, and Yudkowsky on AI progress
Eliezer Yudkowsky, Ajeya Cotra
4y
46
54Biology-Inspired AGI Timelines: The Trick That Never Works
Eliezer Yudkowsky
4y
75
59Reply to Eliezer on Biological Anchors
HoldenKarnofsky
4y
22
34Shulman and Yudkowsky on AI progress
Eliezer Yudkowsky, CarlShulman
4y
5
33More Christiano, Cotra, and Yudkowsky on AI progress
Eliezer Yudkowsky, Ajeya Cotra
4y
12
41Conversation on technology forecasting and gradualism
Richard Ngo, Eliezer Yudkowsky, Rohin Shah, Rob Bensinger
4y
9

Part Three  (Varied Participants)

33Ngo's view on alignment difficulty
Richard Ngo, Eliezer Yudkowsky
4y
1
28Ngo and Yudkowsky on scientific reasoning and pivotal acts
Eliezer Yudkowsky, Richard Ngo
3y
3
30Christiano and Yudkowsky on AI predictions and human intelligence
Eliezer Yudkowsky
3y
24
40Shah and Yudkowsky on alignment failures
Rohin Shah, Eliezer Yudkowsky
3y
24
45Late 2021 MIRI Conversations: AMA / Discussion
Rob Bensinger
3y
100