Nisan's Comments

Vanessa Kosoy's Shortform

My takeaway from this is that if we're doing policy selection in an environment that contains predictors, instead of applying the counterfactual belief that the predictor is always right, we can assume that we get rewarded if the predictor is wrong, and then take maximin.

How would you handle Agent Simulates Predictor? Is that what TRL is for?

An environment for studying counterfactuals

The observation can provide all sorts of information about the universe, including whether exploration occurs. The exact set of possible observations depends on the decision problem.

and can have any relationship, but the most interesting case is when one can infer from with certainty.

Beliefs at different timescales

Thanks, I made this change to the post.

Beliefs at different timescales

Yeah, I think the fact that Elo only models the macrostate makes this an imperfect analogy. I think a better analogy would involve a hybrid model, which assigns a probability to a chess game based on whether each move is plausible (using a policy network), and whether the higher-rated player won.

I don't think the distinction between near-exact and nonexact models is essential here. I bet we could introduce extra entropy into the short-term gas model and the rollout would still be superior for predicting the microstate than the Boltzmann distribution.

Beliefs at different timescales

The sum isn't over , though, it's over all possible tuples of length . Any ideas for how to make that more clear?

EDT solves 5 and 10 with conditional oracles

I'm having trouble following this step of the proof of Theorem 4: "Obviously, the first conditional probability is 1". Since the COD isn't necessarily reflective, couldn't the conditional be anything?

History of the Development of Logical Induction

The linchpin discovery is probably February 2016.

Counterfactuals, thick and thin

Ok. I think that's the way I should have written it, then.

Counterfactuals, thick and thin

Oh, interesting. Would your interpretation be different if the guess occurred well after the coinflip (but before we get to see the coinflip)?

On the Role of Counterfactuals in Learning

What predictions can we get out of this model? If humans use counterfactual reasoning to initialize MCMC, does that imply that humans' implicit world models don't match their explicit counterfactual reasoning?

Load More