I agree that in human context “social compact” ot “pro-social behavior” sound better because this is quite rational behavior.
But in regard to “moral ASI”, I felt that “Stockholm Syndrome” is a better illustration exactly because of its maladaptiveness. While in captivity, it is the same social compact, but when a captor is in the police custody and depends on the witnessing of his ex-captive—the situation is quite similar to an ASI, which could easily overpower humans but because of some preconditioning keeps serving them.
Thanks for your efforts, but I’m not sure I want to be a bannerman for the toxic issue of dissecting morality. Not my area of expertise and, as they say, not the hill I want to die on. Just thought that “moral ASI” is a dangerous misconception.
I agree that in human context “social compact” ot “pro-social behavior” sound better because this is quite rational behavior.
But in regard to “moral ASI”, I felt that “Stockholm Syndrome” is a better illustration exactly because of its maladaptiveness. While in captivity, it is the same social compact, but when a captor is in the police custody and depends on the witnessing of his ex-captive—the situation is quite similar to an ASI, which could easily overpower humans but because of some preconditioning keeps serving them.
Thanks for your efforts, but I’m not sure I want to be a bannerman for the toxic issue of dissecting morality. Not my area of expertise and, as they say, not the hill I want to die on. Just thought that “moral ASI” is a dangerous misconception.
Sorry, ethics and AI is an interest of mine. But yes, discussing it on LW is often a good way to rack up disagreement points.