Of course, you have to wonder, are all those copies of Paul Christiano suffering. They were said to be very similar to the original. Probably no more than the original felt, slightly bored or itchy leg ect. If they really are perfect copies, could they realize they were that, and have an existential freak out? Is it murder to turn off all those similar copies once the jobs done? Will the copies think it is and go on slow strike to live longer?
[Moderator note]: This comment is bringing up a topic that is quite interesting and has had quite a lot of good discussion on LessWrong (see a lot of the writing about Hellscape’s, near misses and Robin Hanson’s thoughts on EMs). But it doesn’t seem to be relevant to the main points of the OP. If you want to have a discussion about this, I recommend you create a new post on your personal blog.
Of course, you have to wonder, are all those copies of Paul Christiano suffering. They were said to be very similar to the original. Probably no more than the original felt, slightly bored or itchy leg ect. If they really are perfect copies, could they realize they were that, and have an existential freak out? Is it murder to turn off all those similar copies once the jobs done? Will the copies think it is and go on slow strike to live longer?
[Moderator note]: This comment is bringing up a topic that is quite interesting and has had quite a lot of good discussion on LessWrong (see a lot of the writing about Hellscape’s, near misses and Robin Hanson’s thoughts on EMs). But it doesn’t seem to be relevant to the main points of the OP. If you want to have a discussion about this, I recommend you create a new post on your personal blog.