Extracting Money from Causal Decision Theorists

Caspar Oesterheld

12 Extracting Money from Causal Decision Theorists

28th Jan 2021

1 min read

12

This is a linkpost for https://doi.org/10.1093/pq/pqaa086

My paper with my Ph.D. advisor Vince Conitzer titled "Extracting Money from Causal Decision Theorists" has been formally published (Open Access) in The Philosophical Quarterly. Probably many of you have seen either earlier drafts of this paper or similar arguments that others have independently given on this forum (e.g., Stuart Armstrong posted about an almost identical scenario; Abram Demski's post on Dutch-Booking CDT also has some similar ideas) and elsewhere (e.g., Spencer (forthcoming) and Ahmed (unpublished) both make arguments that resemble some points from our paper).

Our paper focuses on the following simple scenario which can be used to, you guessed it, extract money from causal decision theorists:

Adversarial Offer: Two boxes, and $B_{2}$ , are on offer. A (risk-neutral) buyer may purchase one or none of the boxes but not both. Each of the two boxes costs $$ 1$ . Yesterday, the seller put $$ 3$ in each box that she predicted the buyer not to acquire. Both the seller and the buyer believe the seller's prediction to be accurate with probability $0.75$ .

At least one of the two boxes contains money. Therefore, the average box contains at least $$ 1.5$ in (unconditional) expectation. In particular, at least one of the two boxes must contain at least $$ 1.5$ in expectation. Since CDT doesn't condition on choosing box $B_{i}$ when assigning an expected utility to choosing box $B_{i}$ , the CDT expected utility of at least one of the two boxes is at least $$ 1.5$ . Thus, CDT agents buy one of the boxes, to the seller's delight.

Most people on this forum are probably already convinced that (orthodox, two-boxing) CDT should be rejected. But I think the Adversarial Offer is one of the more convincing "counterexamples" to CDT. So perhaps the scenario is worth posing to your pro-CDT friends, and the paper worth sending to your pro-academic peer review, pro-CDT friends. (Relating their responses to me would be greatly appreciated – I am quite curious what different causal decision theorists think about this scenario.)

Causal Decision TheoryNewcomb's ProblemRationality

Frontpage

Extracting Money from Causal Decision Theorists

5Paul Christiano

4Caspar Oesterheld

0AVoropaev

New Comment

3 comments, sorted by

top scoring

Click to highlight new comments since: Today at 12:03 AM

[-]Paul Christiano4y50

I like the following example:

Someone offers to play rock-paper-scissors with me.
If I win I get $6. If I lose, I get $5.
Unfortunately, I've learned from experience that this person beats me at rock-paper-scissors 40% of the time, and I only beat them 30% of the time, so in expectation I lose $0.20 in expectation by playing.
My decision is set up as allowing 4 options: rock, paper, scissors, or "don't play."

This seems like a nice relatable example to me---it's not uncommon for someone to offer to bet on a rock paper scissors game, or to offer slightly favorable odds, and it's not uncommon for them to have a slight edge.

Are there features of the boxes case that don't apply in this case, or is it basically equivalent?

[-]Caspar Oesterheld4y40

>If I win I get $6. If I lose, I get $5.

I assume you meant to write: "If I lose, I lose $5."

Yes, these are basically equivalent. (I even mention rock-paper-scissors bots in a footnote.)

[-]AVoropaev4y00

I've skimmed over the beginning of your paper, and I think there might be several problems with it.

I don't see where it is explicitly stated, but I think information "seller's prediction is accurate with probability 0,75" is supposed to be common knowledge. Is it even possible for a non-trivial probabilistic prediction to be a common knowledge? Like, not as in some real-life situation, but as in this condition not being logical contradiction? I am not a specialist on this subject, but it looks like a logical contradiction. And you can prove absolutely anything if your premise contains contradiction.
A minor nitpick compared to the previous one, but you don't specify what you mean by "prediction is accurate with probability 0.75". What kinds of mistakes does seller make? For example, if buyer is going to buy the , then with probability 0.75 the prediction will be " $B_{1}$ ". What about the 0.25? Will it be 0.125 for "none" and 0.125 for " $B_{2}$ "? Will it be 0.25 for "none" and 0 for " $B_{2}$ "? (And does buyer knows about that? What about seller knowing about buyer knowing...)

When you write "$1−P (money in Bi | buyer chooses Bi ) · $3 = $1 − 0.25 · $3 = $0.25.", you assume that P(money in Bi | buyer chooses Bi )=0.75. That is, if buyer chooses the first box, seller can't possibly think that buyer will choose none of the boxes. And the same for the case of buyer choosing the second box. You can easily fix it by writing "$1−P (money in Bi | buyer chooses Bi ) · $3 >= $1 − 0.25 · $3 = $0.25" instead. It is possible that you make some other implicit assumptions about mistakes that seller can make, so you might want to check it.

Moderation Log