AI ALIGNMENT FORUM
AF

320
Books of LessWrong

Incentives

Dec 02, 2021 by Raemon

The third book is about incentives, which are the patterns of what is rewarded and what is punished.

The dynamics of what is incentivized and disincentivized in a group is a primary force in determining how that group behaves. When those incentives are aligned with what the individuals actually want, the output can be far greater than the sum of the parts; when they are misaligned with what the individuals want, the results can be far worse than what any individual in the group would ever choose themselves. 

It is also a perspective to help with understanding one’s own actions, why one is not acting in line with one’s reflected goals, and how to change the path of least resistance for yourself (or other agents).

If we can't see the effects of incentives, many parts of the world will confuse us. The essays in this book will apply this lens to a number of different parts of the world with the goal of better understanding them.

The authors of these essays all participated in a community that awards social status for writing and for insight, and their essays were then selected by a quadratic-voting procedure.

33Asymmetric Justice
Zvi
6y
0
37Unconscious Economics
Bird Concept
7y
0
47Power Buys You Distance From The Crime
Elizabeth
6y
0
54Seeking Power is Often Convergently Instrumental in MDPs
TurnTrout, Logan Riggs
6y
34
68Yes Requires the Possibility of No
Scott Garrabrant
6y
0
51Mistakes with Conservation of Expected Evidence
abramdemski
6y
0
49Heads I Win, Tails?—Never Heard of Her; Or, Selective Reporting and the Tragedy of the Green Rationalists
Zack_M_Davis
6y
0
13Excerpts from a larger discussion about simulacra
Benquo
7y
0
35Moloch Hasn’t Won
Zvi
6y
0
34Integrity and accountability are core parts of rationality
habryka
6y
0
16The Real Rules Have No Exceptions
Said Achmiz
6y
0
11Simple Rules of Law
Zvi
6y
0
27The Amish, and Strategic Norms around Technology
Raemon
6y
0
58Risks from Learned Optimization: Introduction
evhub, Chris van Merwijk, Vlad Mikulik, Joar Skalse, Scott Garrabrant
6y
33
53Gradient hacking
evhub
6y
33