Based on the title alone I was expecting a completely different article: about how our human brains had originally evolved to be so big and great just to outsmart other humans in the political games ever increasing in complexity over millennia and
==thus==>
our value system already steers us to manipulate and deceive others but also ourselves so that we don’t even realize that that’s what our goal system is really about so that we can be more effective at performing those manipulations with straight face
==so==>
any successful attempt at aligning a super-intelligence to our values, will actually result in a super-manipulator which can perfectly hide it from everyone including self diagnostic
Based on the title alone I was expecting a completely different article: about how our human brains had originally evolved to be so big and great just to outsmart other humans in the political games ever increasing in complexity over millennia and
==thus==>
our value system already steers us to manipulate and deceive others but also ourselves so that we don’t even realize that that’s what our goal system is really about so that we can be more effective at performing those manipulations with straight face
==so==>
any successful attempt at aligning a super-intelligence to our values, will actually result in a super-manipulator which can perfectly hide it from everyone including self diagnostic