x

AI ALIGNMENT FORUM
AF

AI Alignment Intro Materials — AI Alignment Forum

AI Alignment Intro Materials

Edited by Raemon, Ruby, Veronica Gordi, plex, et al. last updated 21st Nov 2025

AI Alignment Intro Materials are posts that help someone get oriented and skill up. Distinct from AI Public Materials is that they are more "inward facing" than "outward facing", i.e. for people who are already sold AI risk is a problem and want to upskill.

Some basic intro resources include:

Stampy's AI Safety Info (extensive interactive FAQ)
If Anyone Builds it Everyone dies (book by Eliezer Yudkowsky and Nate Soares)
Scott Alexander's Superintelligence FAQ
The MIRI Intelligence Explosion FAQ
The AGI Safety Fundamentals courses
Superintelligence (book)

2

2

Posts tagged AI Alignment Intro Materials

6

35The Alignment Problem from a Deep Learning Perspective (major rewrite)

SoerenMind, Richard_Ngo, LawrenceC

3y

2

1

6"Corrigibility at some small length" by dath ilan

Christopher King

3y

1

2

12A newcomer’s guide to the technical AI safety field

3y

1

0

102AI Control: Improving Safety Despite Intentional Subversion

Buck, Fabien Roger, ryan_greenblatt, Kshitij Sachan

2y

5

1

48A short course on AGI safety from the GDM Alignment team

Vika, Rohin Shah

10mo

0

1

23Wikipedia as an introduction to the alignment problem

3y

0

1

26A starter guide for evals

Marius Hobbhahn, Jérémy Scheurer, Mikita Balesni, rusheb, AlexMeinke

2y

0

1

17UC Berkeley course on LLMs and ML Safety

1y

1

0

73Shallow review of technical AI safety, 2024

technicalities, Stag, Stephen McAleese, jordine, Dr. David Mathers

1y

1

1

23An Exercise to Build Intuitions on AGI Risk

2y

3

Add Posts