The utility function picture of a rational agent maps perfectly onto the Orthogonality thesis: here have the goal structure, the utility fu...
...could be “here we have the...
From 3.2
Human minds remain our only real model of general intelligence, and this strongly direct and informs...
this strongly directs and informs...
From 4.1
“All human-designed rational beings would follow the same morality (or one of small sets of moralities)” sound plausible; in contract “All human-designed superefficient
I think it would be sounds since the subject is the argument, even though the argument contains plural subjects, and I think you meant “in contrast”, but I may be mistaken.
Just some minor text corrections for you:
From 3.1
...could be “here we have the...
From 3.2
this strongly directs and informs...
From 4.1
I think it would be sounds since the subject is the argument, even though the argument contains plural subjects, and I think you meant “in contrast”, but I may be mistaken.
From 3.3
to do so(?) we would
From 3.4
of a single given agent
From 4.1
every, or change the rest of the sentence (superintelligences, they were)
From 4.5