So, I don’t think we need AGI for this… But Digital humans. Uploads from preserved brains. The freedom from carbon-based substrate, and the benefits that go with that like immortality and speed-of-light travel.
I suggest that ideally we keep AI as weak as possible to get us quickly to digital humans, and then have the digital humans do the AI work. Never go down the path of non-human intelligence which is fully superior to human intelligence. Keep the future human! Empower Us, not Them!
(This response gives me a human chauvinist vibe. I’m sympathetic to really carefully thinking thing through before handing control to quite alien beings, but at some point, we’ll probably want to have control in the hands of beings which look very different than current humans. Also, the direct value might come from entities which aren’t well described as human.)
Yes, that’s correct. I’m transhuman-chauvinist. I want our present and future to belong as much as possible to humans and our enhanced descendants, not to alien minds who may not share my values. There absolutely are non-human minds I’d like to create and experience living with and share the future in an equitable way with, but it is a highly restricted set based on compatibility with my own values. For instance, uplifted mammals or digital humans. Many people might not describe either of those groups as ‘human’, but I’d still consider them within group human-ish. Of course, the human-ish group isn’t a team, it’s a category. Within that there are opposed factions actively killing each other. I’d prefer if that wasn’t the case. I don’t have a plan for aligning human-ish creatures to each other sufficiently to achieve a peaceful society, but I do suspect that this would be easier than aligning a group of actors including both human-ish actors and very alien actors. Until we have such a plan, probably we shouldn’t hand much power over to potentially non-peaceful alien actors.
So, I don’t think we need AGI for this… But Digital humans. Uploads from preserved brains. The freedom from carbon-based substrate, and the benefits that go with that like immortality and speed-of-light travel.
I suggest that ideally we keep AI as weak as possible to get us quickly to digital humans, and then have the digital humans do the AI work. Never go down the path of non-human intelligence which is fully superior to human intelligence. Keep the future human! Empower Us, not Them!
(This response gives me a human chauvinist vibe. I’m sympathetic to really carefully thinking thing through before handing control to quite alien beings, but at some point, we’ll probably want to have control in the hands of beings which look very different than current humans. Also, the direct value might come from entities which aren’t well described as human.)
Yes, that’s correct. I’m transhuman-chauvinist. I want our present and future to belong as much as possible to humans and our enhanced descendants, not to alien minds who may not share my values. There absolutely are non-human minds I’d like to create and experience living with and share the future in an equitable way with, but it is a highly restricted set based on compatibility with my own values. For instance, uplifted mammals or digital humans. Many people might not describe either of those groups as ‘human’, but I’d still consider them within group human-ish. Of course, the human-ish group isn’t a team, it’s a category. Within that there are opposed factions actively killing each other. I’d prefer if that wasn’t the case. I don’t have a plan for aligning human-ish creatures to each other sufficiently to achieve a peaceful society, but I do suspect that this would be easier than aligning a group of actors including both human-ish actors and very alien actors. Until we have such a plan, probably we shouldn’t hand much power over to potentially non-peaceful alien actors.