Hence “deep in the mind”, not brain: defined in a model, not explicitly represented. Although there is more preference-defining stuff outside the mind (or rather outside the brain...).
To be honest, I wasn’t thinking of the the distinction between mind and brain when I wrote that, so Eliezer’s correction is on target. I was visualizing the utility function as something that exists and must be discovered.
Hence “deep in the mind”, not brain: defined in a model, not explicitly represented. Although there is more preference-defining stuff outside the mind (or rather outside the brain...).
To be honest, I wasn’t thinking of the the distinction between mind and brain when I wrote that, so Eliezer’s correction is on target. I was visualizing the utility function as something that exists and must be discovered.