I think that if I took over the world it might cause me to go Unfriendly; that is, there’s a nontrivial chance that the values of a DSimon that rules the world would diverge from my current values sharply and somewhat quickly.
Basically, I just don’t think I’m immune to corruption, so I don’t personally want to rule the world. However, I do wish that the world had an effective ruler that shared my current values.
See this comment. The intended meaning is managing to get your values to successfully optimize the world, not for your fallible human mind to issue orders.
Your actions are pretty “Unfriendly” even now, to the extent they don’t further your values because of poor knowledge of what you actually want and poor ability to form efficient plans.
I think that if I took over the world it might cause me to go Unfriendly; that is, there’s a nontrivial chance that the values of a DSimon that rules the world would diverge from my current values sharply and somewhat quickly.
Basically, I just don’t think I’m immune to corruption, so I don’t personally want to rule the world. However, I do wish that the world had an effective ruler that shared my current values.
See this comment. The intended meaning is managing to get your values to successfully optimize the world, not for your fallible human mind to issue orders.
Your actions are pretty “Unfriendly” even now, to the extent they don’t further your values because of poor knowledge of what you actually want and poor ability to form efficient plans.