However, consider the reflection process defined as follows: it takes in information from the real world and the utility function output from the previous iteration of reflection, and has a human deliberate for a while and then outputs the improved utility function and crucially also an improved reflection process to be used in the next iteration...
This assumes that the output is a utility function. Gotta be careful with that kind of assumption when defining a process meant to capture “the best we could do”; it may turn out that we could, on reflection, come up with a better output than a utility function.
This assumes that the output is a utility function. Gotta be careful with that kind of assumption when defining a process meant to capture “the best we could do”; it may turn out that we could, on reflection, come up with a better output than a utility function.