I think these are good questions. I don’t trust “morality.” The morality that we do have we have because it “works.” Make your ideas pay rent, make your morality pay rent. We cooperate by the millions and billions because of language and morality and the fact that we have very largely domesticated ourselves.
I imagine the Kurzweilian singularity to be more like what will happen than free standing AIs engineered with CEV or something else from the ground up. Its a lot easier to “own” an intelligence when it is physically part of you and dependent on you. It is a lot easier to design enhancements to a already complex and adaptable intelligence. Perhaps more important than calling it easier is to note it is a lot less expensive..
Humanity has already fractured into groups and the win for the species has been that to a large extent we still function as a single intelligence. Enhanced memory and communication should reinforce that win, at least in the medium term. Perhaps there is a day when the Galactic Center band of man-machines has been separated from the Spiral Arm band of man-machines for long enough for the bonds between them to have atrophied, perhaps not. We have to leave SOME problems for our enhanced offspring to solve, though, and we have plenty of reason to believe they will be better equipped to solve these than are we.
I think these are good questions. I don’t trust “morality.” The morality that we do have we have because it “works.” Make your ideas pay rent, make your morality pay rent. We cooperate by the millions and billions because of language and morality and the fact that we have very largely domesticated ourselves.
I imagine the Kurzweilian singularity to be more like what will happen than free standing AIs engineered with CEV or something else from the ground up. Its a lot easier to “own” an intelligence when it is physically part of you and dependent on you. It is a lot easier to design enhancements to a already complex and adaptable intelligence. Perhaps more important than calling it easier is to note it is a lot less expensive..
Humanity has already fractured into groups and the win for the species has been that to a large extent we still function as a single intelligence. Enhanced memory and communication should reinforce that win, at least in the medium term. Perhaps there is a day when the Galactic Center band of man-machines has been separated from the Spiral Arm band of man-machines for long enough for the bonds between them to have atrophied, perhaps not. We have to leave SOME problems for our enhanced offspring to solve, though, and we have plenty of reason to believe they will be better equipped to solve these than are we.