You can reduce an AGI to the behavior of computer chips (or whatever fancy-schmancy substrate they end up running on), which are themselves just channels for the flow of electrons. Nothing mental there. Friendliness is a description of the utility function and decision theory of an AGI, both of which can be reduced to patterns of electrons on a computer chip.
It’s all electrons floating around. We just talk about ridiculous abstract things like AGI and Friendliness because it makes the math tractable.
You can reduce an AGI to the behavior of computer chips (or whatever fancy-schmancy substrate they end up running on), which are themselves just channels for the flow of electrons. Nothing mental there. Friendliness is a description of the utility function and decision theory of an AGI, both of which can be reduced to patterns of electrons on a computer chip.
It’s all electrons floating around. We just talk about ridiculous abstract things like AGI and Friendliness because it makes the math tractable.