Once you give up on that idea, you’re reduced, as in this post, to the tribalist position of arguing that we humans should pursue our own interests, and the Pebblesorters be damned. When a conflict arises (as it inevitably will), the winner will then be whoever has the bigger guns, or builds AI first.
I don’t think so. I don’t think it’s h-right to destroy or reprogram the pebblesorters, so if we’re exploring space and find them, I don’t think we’ll do that.
It may be P-right for them to re-program us to forget about h-right and just start sorting pebbles, though, so we want to watch out to make sure that doesn’t happen..
I think the mistake that most “moral relativists” make is that they forget about the shared human morality we all have, and therefore claim that it’s all arbitrary and meaningless.
I don’t think so. I don’t think it’s h-right to destroy or reprogram the pebblesorters, so if we’re exploring space and find them, I don’t think we’ll do that.
It may be P-right for them to re-program us to forget about h-right and just start sorting pebbles, though, so we want to watch out to make sure that doesn’t happen..
I think the mistake that most “moral relativists” make is that they forget about the shared human morality we all have, and therefore claim that it’s all arbitrary and meaningless.