Günther: Well, human values have given us war, poverty, cruelty, oppression, what have you...and yes, it was “values” that gave us these things. Very few humans want to do evil things, most actually think they are doing good when they do bad onto others.
I think Eliezer answered to this in No License To Be Human. You don’t follow “values” because they are “values”, some values may be discarded in the course of moral progress if they turn out to be wrong, and some can be studied if they explain the structure of right, contributing to the resulting moral dynamic.
Günther: Well, human values have given us war, poverty, cruelty, oppression, what have you...and yes, it was “values” that gave us these things. Very few humans want to do evil things, most actually think they are doing good when they do bad onto others.
I think Eliezer answered to this in No License To Be Human. You don’t follow “values” because they are “values”, some values may be discarded in the course of moral progress if they turn out to be wrong, and some can be studied if they explain the structure of right, contributing to the resulting moral dynamic.