A road contains two-identical looking intersections. An absent-minded driver wants to exit at the second intersection, but can't remember if they've passed the first intersection already.
The utility of exiting at the first intersection is $0, the utility of exiting at the second intersection is $4, and the utility of continuing straight past both intersections is $1. [1]
With what probability should the driver continue vs. exit at a generic-looking intersection, in order to maximize their expected utility?
From the standpoint of Newcomblike problems, the Absent-Minded Driver is noteworthy because the logical correlation of the two decisions arises just from the agent's imperfect memory (anterograde amnesia or limited storage space). There is no outside Omega making predictions about the agent; any problem that the agent encounters is strictly of its own making.
The driver doesn't know each time whether they're at the first or second intersection, so will continue with the same probability at each intersection. The expected payoff of adopting as a policy is the sum of:
To find the maximum of the function we set the derivative equal to 0 yielding .
So the driver should continue with 2/3 probability and exit with 1/3 probability at each intersection, yielding an expected payoff of
The analysis of this problem under causal decision theory has traditionally been considered difficult; e.g., Volume 20 of the journal Games and Economic Behavior was devoted entirely to the Absent-Minded Driver game.
Suppose that before you set out on your journey, you intended to adopt a policy of continuing with probability 2/3. Then when you actually encounter an intersection, you believe you are at the second intersection with probability 3/5. (There is a 100% or 3/3 chance of encountering the first intersection, and a 2/3 chance of encountering the second intersection. So the odds are 3 : 2 for being in the first intersection versus the second intersection.)
Now since you are not a logical decision theorist, you believe that if you happen to already be at the second intersection, you can change your policy without retroactively affecting the probability that you're already at the second intersection - either you're already at the second intersection or not, after all!
The first analysis of this problem was given by Piccione and Rubinstein (1997):
Suppose we start out believing we are continuing with probability Then our odds of being at the first vs. second intersection would be so the probability of being at each intersection would be and respectively.
If we're at the first intersection and we choose a policy we should expect a future payoff of If we're already at the second intersection, we should expect a policy 's future payoff to be
In total our expected payoff is then whose derivative equals 0 at
Our decision at will be stable only if the resulting maximum of is equal to and this is true when The expected payoff from this policy is
However, the immediately following paper by Robert Aumann et. al. (1997) offered an alternative analysis in which, starting out believing our policy to be , if we are at the first intersection, then our decision also cannot affect our decision that will be made at the second intersection. [2] So:
So if our policy is the expected payoff of the policy under CDT is:
Differentiating with respect to p yields which has no dependency on This makes a kind of sense, since if your decision now has no impact on your past or future decision at the other intersection, most settings of will just yield an answer of "definitely turn right" or "definitely turn left". However, there is a setting of which makes any policy seem equally desirable, the point at which Aumann et al. take this to imply that a CDT agent should output a of 2/3.
One might ask how this result of 2/3 is actually rendered into an output, since on the analysis of Aumann et. al., if your policy in the past or future is to continue with 2/3 probability, then any policy seems to have equal utility. However, outputting =2/3 would also correspond to the general procedure proposed to resolve e.g. Death in Damascus within CDT. Allegedly, it is just a general rule of the principle of rational choice that in this type of problem one should find a policy where, assuming one implements that policy, all policies look equally good, and then do that.
Further analyses have, e.g., remarked on the analogy to the Sleeping Beauty Problem and delved into anthropics; or considered the problem as a game between two different agents occupying each intersection, etcetera. It is considered nice to arrive at an answer of 2/3 at the end, but this is not mandatory.
Logical decision theorists using, e.g., the updateless form of timeless decision theory, will compute an answer of 2/3 using the same procedure and computation as in the intuitive/pretheoretic version. They will also remark that it is strange to imagine that the reasonable answer could be different from the optimal policy, or even that they should require a different reasoning path to compute; and will note that while simplicity is not the only virtue of a theory of instrumental rationality, it is a virtue.
Utility functions describe the relative desirability intervals between outcomes. So this payoff matrix says that the added inconvenience of "going past both intersections" compared to "turning right at 2nd" is 1/4 of the added inconvenience of "turning right at 1st" compared to "turning right at 2nd". Perhaps turning right at 1st involves a much longer detour by the time the driver realizes their mistake, or a traffic-jammed stoplight to get back on the road.