AI ALIGNMENT FORUM
AF

744
Toying With Goal-Directedness

Toying With Goal-Directedness

Jun 11, 2020 by adamShimi

We (Adam Shimi, Joe Collman, Michele Campolo and Sabrina Tang) are studying both how to formalize the intuitions behind goal-directedness, and what is its relevance to AI Safety. This sequence is here for the not fully polished posts that represent more the ideas of their specific author than a consensus inside the group.

9Goal-directed = Model-based RL?
adamShimi
6y
0
10Focus: you are allowed to be bad at accomplishing your goals
adamShimi
5y
9
3Goal-directedness is behavioral, not structural
adamShimi
5y
12
11Locality of goals
adamShimi
5y
7
7Goals and short descriptions
Michele Campolo
5y
8
4Goal-Directedness: What Success Looks Like
adamShimi
5y
0