ScienceBall

I don’t want an AGI to intrinsically care about the welfare of a photo of a human. Do you?

Well, I know that a photo's "welfare" isn't real. But I was just thinking about how humans can appreciate art and fiction, and I think some of that appreciation is based on the "innate drive to pay attention to people" and emotional responses to the people and emotions depicted in the art/narrative. So I was just thinking about it in terms of my preference that "the AGI can enjoy many things that humans enjoy", or "the AGI can relate to human experience to some extent... (read more)

Thanks for writing this. I have a bunch of thoughts I want to share. Some of them are direct responses to things you wrote in this post, and others are responding more generally to the idea of making a human-like AGI (I posted them here because this is your post that talks about the whole plan).

1. In footnote 2, you write "There are many other social drives besides those four … the “drive to feel feared”, play, a “drive to think about or interact with other people” (§5 here), loneliness (cf. Liu et al. 2025), love, lust, various moods, and so on. I basically