So does rationality determine what a person or group values, or is it merely a tool to be used towards subjective values?
Dunno about “merely”, but yeah, the thing LW refers to by “rationality” is a tool that can be used to promote any values.
My scenario does not assume that all of humanity views themselves as one in-group. Whereas what you are saying assumes that it does.
I don’t think it assumes that, actually. You mentioned “a world of majorly rational people [..] killing us all faster.” I don’t see how a world of people who are better at achieving what they value results in all of us being killed faster, unless people value killing all of us.
If what I value is killing you and surviving myself, and you value the same, but we end up taking steps that result in both of us dying, it would appear we have failed to take steps that optimize for our goals. Perhaps if we were better at optimizing for our goals, we would have taken different steps.
do you not think that the eradication of competing out groups could be seen as increasing in-group survival?
Sure.
Almost entirely orthogonal.
You are going to have to explain what you mean here.
I mean that whether humanity is digitized has almost nothing to do with the perceived end goal.
Dunno about “merely”, but yeah, the thing LW refers to by “rationality” is a tool that can be used to promote any values.
I don’t think it assumes that, actually. You mentioned “a world of majorly rational people [..] killing us all faster.” I don’t see how a world of people who are better at achieving what they value results in all of us being killed faster, unless people value killing all of us.
If what I value is killing you and surviving myself, and you value the same, but we end up taking steps that result in both of us dying, it would appear we have failed to take steps that optimize for our goals. Perhaps if we were better at optimizing for our goals, we would have taken different steps.
Sure.
I mean that whether humanity is digitized has almost nothing to do with the perceived end goal.