Here is a proposal for Inverse Reinforcement Learning in General Environments. (2 1/2 pages; very little math).
Copying the introduction here:
The eventual aim of IRL is to understand human goals. However, typical algorithms for IRL assume the environment is finite-state Markov, and it is often left unspecified how raw observational data would be converted into a record of human actions, alongside the space of actions available. For IRL to learn human goals, the AI has to consider general environments, and it has to have a way of identifying human actions. Lest these extensions appear trivial, I consider one of the simplest proposals, and discuss some difficulties that might arise.
I mean, he has, see Research Priorities for Robust and Beneficial Artificial Intelligence,
Thanks for this reference, but it's co-authored with Daniel Dewey and Max Tegmark and seems to serve as an overview of AI safety research agendas that existed in 2015 rather than Stuart Russell's personal research priorities. (It actually seems to cite MIRI and Bostrom more than anyone else.)
and the articles you quote.
The ones I looked at all seemed to be written at a very high level for a general (not even ML/AI researchers) audience (and as you noted seem to be overly simplified compared to his actual views). What is the best reference for explaining his personal view of AI risk/safety? I'm happy to read something that's written for a non-LW research audience.
(EDIT: Removed part about grad students, as it seems more understandable at this point for them to not have written up their views yet.)
Here is a proposal for Inverse Reinforcement Learning in General Environments. (2 1/2 pages; very little math).
Copying the introduction here:
The eventual aim of IRL is to understand human goals. However, typical algorithms for IRL assume the environment is finite-state Markov, and it is often left unspecified how raw observational data would be converted into a record of human actions, alongside the space of actions available. For IRL to learn human goals, the AI has to consider general environments, and it has to have a way of identifying human actions. Lest these extensions appear trivial, I consider one of the simplest proposals, and discuss some difficulties that might arise.