Clippy is usually brought up as a most dangerous AI that we should avoid creating at all costs, yet what’s the point of creating copies of us and tile the universe with them? how is that different than what clippy does?
That’s an easy one. I value humans, I don’t value paperclips.
Shouldn’t we focus on engineered/controlled value drift rather than preventing it entirely?
According to EY’s CEV document, CEV does this. It lets/makes our values drift in the way we would want them to drift.
and as far as I remember CEV was sort of abandoned a while ago by the community.
and yes, you value humans, others in the not so distant future might not given the possibility of body/brain modification.
anyway, the gist of my argument is that CEV doesn’t seem to work if there is not going to be much coherence of all of humanity’s extrapolated volition’s-a point that’s already been made clear in previous threads by many people-what I’m trying to add to that is to point out the overwhelming possibility of there being ‘alien minds’ among us before a FAI could be built.
I also raised the question that If body modification is widely available, is it ok to prevent people from acquiring an ‘alien’ set of morals, one that would later on be a possible hindrance to CEV-like proposals? how can we tell if its alien or not in the first place?
That’s an easy one. I value humans, I don’t value paperclips.
According to EY’s CEV document, CEV does this. It lets/makes our values drift in the way we would want them to drift.
very smart people have issues with CEV, example: http://lesswrong.com/lw/2b7/hacking_the_cev_for_fun_and_profit/
and as far as I remember CEV was sort of abandoned a while ago by the community.
and yes, you value humans, others in the not so distant future might not given the possibility of body/brain modification. anyway, the gist of my argument is that CEV doesn’t seem to work if there is not going to be much coherence of all of humanity’s extrapolated volition’s-a point that’s already been made clear in previous threads by many people-what I’m trying to add to that is to point out the overwhelming possibility of there being ‘alien minds’ among us before a FAI could be built.
I also raised the question that If body modification is widely available, is it ok to prevent people from acquiring an ‘alien’ set of morals, one that would later on be a possible hindrance to CEV-like proposals? how can we tell if its alien or not in the first place?