There is an assumption that in every timeline, either you die or it becomes good indefinitely. I am not seeing a reason for that assumption. What excludes a timeline from being bad indefinitely?
Nothing directly prevents this, but it seems reasonable to assume that “I don’t care about humans” is a more likely failure mode for AI than “I care about humans in a way that is bad for them but won’t kill them”.
I agree that it’s a possibility though.
There is an assumption that in every timeline, either you die or it becomes good indefinitely. I am not seeing a reason for that assumption. What excludes a timeline from being bad indefinitely?
Nothing directly prevents this, but it seems reasonable to assume that “I don’t care about humans” is a more likely failure mode for AI than “I care about humans in a way that is bad for them but won’t kill them”. I agree that it’s a possibility though.