Defeating Goodhart and the "closest unblocked strategy" problem
Learning "known" information when the information is not actually known
Relative exchange rate between preferences
Being wrong in ethics
Models of preferences in distant situations
The low cost of human preference incoherence
"Moral" as a preference label
Partial preferences and models
Combining individual preference utility functions
Mysteries, identity, and preferences over non-rewards