AI ALIGNMENT FORUM
AF

107
Wikitags

Disagreement

Edited by Ruby, Multicore, et al. last updated 26th Nov 2021

Disagreement is when two people have different beliefs.

Aumann's Agreement Theorem

Considered of particular relevance to disagreement between people trying to be rational, Aumann's agreement theorem can be informally interpreted as suggesting that if two people are honest seekers of truth, and both believe each other to be honest, then they should update on each other's opinions and quickly reach agreement. The very fact that a person believes something is Rational evidence that that something is true, and so this fact should be taken into account when forming your belief.

Outside of well-functioning prediction markets, Aumann agreement can probably only be approximated by careful deliberative discourse. Interest in Aumann agreement has waned in recent years within the Rationalist community, perhaps out of a sense Aumann agreement cannot be practically achieved by humans – there is too much background information to be exchanged. Instead, people now focus on things more like Double-Crux

External Posts

  • Reasonable Disagreement by Nicholas Shackel
  • Agreeing to Agree by Hal Finney
  • You Are Never Entitled to Your Opinion by Robin Hanson
  • Normative Bayesianism and Disagreement by Nicholas Shackel
  • Disagreement is Near/Far Bias by Robin Hanson
  • The Seven Causes of Disagreement by Spencer Greenberg
  • How to Disagree by Paul Graham

See also

  • Aumann's agreement theorem
  • Modesty argument
  • Disagreements on Less Wrong
  • Arguments as soldiers
  • Double-Crux
  • Conversation

References

(PDF, Talk video)

  • We Can't Disagree Forever by John Geanakoplos and Heraklis Polemarchakis
  • Information, Trade, and Common Knowledge by Paul Milgrom and Nancy Stokey
Subscribe
Discussion
1
Subscribe
Discussion
1
Posts tagged Disagreement
11AXRP Episode 3 - Negotiable Reinforcement Learning with Andrew Critch
DanielFilan
5y
0
Add Posts