komponisto

If asked to define what an agent is, my usual answer -- one of them, anyway -- is “a worldline in Tegmark V”. The Tegmark Level V Multiverse (the “V” here is a Roman numeral) is not defined by Max Tegmark (whose hierarchy goes only up to IV), but, as...

I agree that optimization amplifies things. I also agree that a mathematical mindset is important for AI alignment. I don't, however, think that a "mathematical mindset" is the same as a "proof mindset". Rather, I think that the latter is closer to being a "programming mindset" -- or, indeed, a...