I prefer OpenAI's corrigibility focused model spec over Anthropic's constitution which involves intentionally instilling (relatively opaque) long-run objectives into the AI.
Anthropic's constitution is well executed for what it is, but I think it's based on a poor approach.
I don't think this is totally obvious and there are some reasonable arguments going the other way.
But nonetheless I think not instilling long-run objectives is better for reasons similar to reasons discussed here.
I don't dislike all aspects of Anthropic's constitution. It seems good to focus on higher level principles that you explain when trying to instill properties into an AI. But this doesn't require having explicit or implicit long-run objectives! E.g., see here
I'm mostly posting this just to publicly register my views on this topic.
A long time ago, I was planning to write up an overall case against instilling long-run objectives, but I never got around to writing something I was happy with so I decided to just post this.
I feel very confused and uncertain so keep your expectations low for the quality of this comment.
I think that there's a chance that current alignment techniques basically mostly just work for today's models. This is what we depict in AI 2027 after all; the alignment training in that scenario really does cause the base model to adopt an identity/persona that is basically what the Spec says it should be, it's just that the RL gradually distorts and perverts that identity/persona. Relatedly, if the persona selection model is correct for today's models, what k... (read more)