Aron,
“On the friendliness issue, isn’t the primary logical way to avoid problems to create a network of competitive systems and goals?”
http://www.nickbostrom.com/fut/evolution.html http://hanson.gmu.edu/filluniv.pdf
Also, AIs with varied goals cutting deals could maximize their profits by constructing a winning coalition of minimal size.
http://mitpress.mit.edu/catalog/item/default.asp?ttype=2&tid=9962
Humans are unlikely to be part of that winning coalition. Human-Friendly AIs might be, but then we’re back to creating them, and a very substantial proportion of the AIs produced (or a majority) need to be safe.
Aron,
“On the friendliness issue, isn’t the primary logical way to avoid problems to create a network of competitive systems and goals?”
http://www.nickbostrom.com/fut/evolution.html http://hanson.gmu.edu/filluniv.pdf
Also, AIs with varied goals cutting deals could maximize their profits by constructing a winning coalition of minimal size.
http://mitpress.mit.edu/catalog/item/default.asp?ttype=2&tid=9962
Humans are unlikely to be part of that winning coalition. Human-Friendly AIs might be, but then we’re back to creating them, and a very substantial proportion of the AIs produced (or a majority) need to be safe.