Read the paper draft here.
I'm working on a a paper with Benja introducing probabilistic oracle machines and showing how they are equivalent with Nash equilibria, as I initially argued in a comment. This variant of the reflective oracles was originally suggested in Paul Christiano's comment. We might end up submitting a later version of this paper to a conference. Any comments or criticism are very welcome!