Richard: Roko, will you please exhibit a mind that you believe is not a utility maximizer?
Consider the following toy universe U, which has 2 possible states—A and B, and where time is indexed by the natural numbers. The following pseudo-code does not embody a utility maximizing agent:
Richard: Roko, will you please exhibit a mind that you believe is not a utility maximizer?
Consider the following toy universe U, which has 2 possible states—A and B, and where time is indexed by the natural numbers. The following pseudo-code does not embody a utility maximizing agent:
10: motor-output{A} 20: motor-output{B} 30: GOTO{10}
The following agent
10: motor-output{A} 20: END
does embody a utility maximizer with utility function U(A) = 1, U(B) = 0