AI ALIGNMENT FORUM
AF

Academic PapersCausalityMachine Learning (ML)Mechanism Design
Frontpage

10

New paper: The Incentives that Shape Behaviour

by RyanCarey
23rd Jan 2020
1 min read
5

10

This is a linkpost for https://arxiv.org/abs/2001.07118
Academic PapersCausalityMachine Learning (ML)Mechanism Design
Frontpage
New paper: The Incentives that Shape Behaviour
5habryka
1RyanCarey
5habryka
New Comment
3 comments, sorted by
top scoring
Click to highlight new comments since: Today at 2:09 PM
[-]habryka6y50

Mod note: I edited the abstract into the post, since that makes the paper more easily searchable in the site-search, and also seems like it would help people get a sense of whether they want to click through to the link. Let me know if you want me to revert that. 

Reply
[-]RyanCarey6y10

Thanks!

Reply
[-]habryka6y50

I quite liked this paper, and read through it this morning. It also seems good to link to the accompanying Medium post, which I found a good introduction into the ideas: 

https://medium.com/@RyanCarey/new-paper-the-incentives-that-shape-behaviour-d6d8bb77d2e4?fbclid=IwAR0hHcQTnAtSzxSONWWxw4pYNpiHBAsuaN8DT6GTz7oO1gxvjPc9R8VVhpY

Reply
Moderation Log
More from RyanCarey
View more
Curated and popular this week
3Comments

Abstract: Which variables does an agent have an incentive to control with its decision, and which variables does it have an incentive to respond to? We formalise these incentives, and demonstrate unique graphical criteria for detecting them in any single decision causal influence diagram. To this end, we introduce structural causal influence models, a hybrid of the influence diagram and structural causal model frameworks. Finally, we illustrate how these incentives predict agent incentives in both fairness and AI safety applications.