This article made me think of an idea, which I’m not sure if it’s actually contained in the article but it is sort of nearby. It’s a Basic AI Drive to ensure that it persists with its goal system intact. An AI that identified itself with humanity and identified its goals with our aggregate goals sounds like a potentially useful approach to something in the neighborhood of CEV (as opposed to trying to figure out what we want ourselves and then figuring out how to program that in, say).
It is somewhat implicit. I figured I might do a sequence if I had time. I’m interested in whether it would be a good idea to make computational systems that lack the equivalent of parts of the brains that deals with what is sort after or avoided (this isn’t the whole goal system but it shapes the goal system in humans) and most likely placing a single human in its place. And having multiple systems for society type effects and redundency.
And well done for linking in with concepts from Omohundro, I should have done that in the article.
This article made me think of an idea, which I’m not sure if it’s actually contained in the article but it is sort of nearby. It’s a Basic AI Drive to ensure that it persists with its goal system intact. An AI that identified itself with humanity and identified its goals with our aggregate goals sounds like a potentially useful approach to something in the neighborhood of CEV (as opposed to trying to figure out what we want ourselves and then figuring out how to program that in, say).
It is somewhat implicit. I figured I might do a sequence if I had time. I’m interested in whether it would be a good idea to make computational systems that lack the equivalent of parts of the brains that deals with what is sort after or avoided (this isn’t the whole goal system but it shapes the goal system in humans) and most likely placing a single human in its place. And having multiple systems for society type effects and redundency.
And well done for linking in with concepts from Omohundro, I should have done that in the article.