AI ALIGNMENT FORUM
AF

Wikitags

Functional Decision Theory

Edited by Yoav Ravid, Heighn, Mikhail Samin, et al. last updated 21st Mar 2025

Functional Decision Theory is a decision theory described by Eliezer Yudkowsky and Nate Soares which says that agents should treat one’s decision as the output of a fixed mathematical function that answers the question, “Which output of this very function would yield the best outcome?”. It is a replacement of Timeless Decision Theory, and it outperforms other decision theories such as Causal Decision Theory (CDT) and Evidential Decision Theory (EDT). For example, it does better than CDT on Newcomb's Problem, better than EDT on the smoking lesion problem, and better than both in Parfit’s hitchhiker problem.

In Newcomb's Problem, an FDT agent reasons that Omega must have used some kind of model of her decision procedure in order to make an accurate prediction of her behavior. Omega's model and the agent are therefore both calculating the same function (the agent's decision procedure): they are subjunctively dependent on that function. Given perfect prediction by Omega, there are therefore only two outcomes in Newcomb's Problem: either the agent one-boxes and Omega predicted it (because its model also one-boxed), or the agent two-boxes and Omega predicted that. Because one-boxing then results in a million and two-boxing only in a thousand dollars, the FDT agent one-boxes.

External links:

  • Functional decision theory: A new theory of instrumental rationality
  • Cheating Death in Damascus
  • Decisions are for making bad outcomes inconsistent
  • On Functional Decision Theory by Wolfgang Schwarz

See Also:

  • Timeless Decision Theory
  • Updateless Decision Theory
  • Superrationality
  • Introduction to Logical Decision Theory for Computer Scientists
  • Introduction to Logical Decision Theory for Economists
  • Introduction to Logical Decision Theory for Analytic Philosophers
  • An Introduction to Logical Decision Theory for Everyone Else
Subscribe
1
Subscribe
1
Discussion0
Discussion0
Posts tagged Functional Decision Theory
22MIRI/OP exchange about decision theory
Rob Bensinger
4y
5
30A Critique of Functional Decision Theory
wdmacaskill
6y
26
17AXRP Episode 5 - Infra-Bayesianism with Vanessa Kosoy
DanielFilan
4y
2
11Let's Discuss Functional Decision Theory
Chris_Leong
7y
0
6Deconfusing Logical Counterfactuals
Chris_Leong
7y
0
Add Posts