I should probably add that I am not in favor of using any brand new philosophical ideas—like the ones that I like to think about—to write the goal system of a seed AI. That would be far too dangerous. For this purpose, I think we should simply concentrate on encoding the values that we already have into an AI—for example using the CEV concept.
I am interested in UIVs because I’m interested in formalizing the philosophy of transhumanism. This may become important because we may enter a slow takeoff, non-AI singularity.
@ marcello, quasi-anonymous, manuel:
I should probably add that I am not in favor of using any brand new philosophical ideas—like the ones that I like to think about—to write the goal system of a seed AI. That would be far too dangerous. For this purpose, I think we should simply concentrate on encoding the values that we already have into an AI—for example using the CEV concept.
I am interested in UIVs because I’m interested in formalizing the philosophy of transhumanism. This may become important because we may enter a slow takeoff, non-AI singularity.