AI ALIGNMENT FORUM
Shard Theory
AF

Shard Theory

Written by Quintin Pope, Alex Turner, Charles Foster, and Logan Smith. Card image generated by DALL-E 2:

59Humans provide an untapped wealth of evidence about alignment

Alex Turner, Quintin Pope

3y

42

42Human values & biases are inaccessible to the genome

3y

38

26General alignment properties

3y

2

29Evolution is a bad analogy for AGI: inner alignment

3y

1

94Reward is not the optimization target

3y

88

74The shard theory of human values

Quintin Pope, Alex Turner

3y

33

23Understanding and avoiding value drift

3y

7

36A shot at the diamond-alignment problem

3y

45

32Don't design agents which exploit adversarial inputs

Alex Turner, Garrett Baker

3y

33

24Don't align agents to evaluations of plans

2y

32

29Alignment allows "nonrobust" decision-influences and doesn't require robust grading

2y

31

47Inner and outer alignment decompose one hard problem into two extremely hard problems

2y

14