I agree, and I would question the notion of reflective equilibrium myself on those grounds. Here I’m mostly using it as an example of what “actual values” might be, in contrast with “mere behavior”, in order to point out that Eliezer’s “Thou Art Godshatter” argument is not sufficient to show that our values are actually complex.
I don’t see why such a “reflective equilibrium” should be well defined and/or unique.
I agree, and I would question the notion of reflective equilibrium myself on those grounds. Here I’m mostly using it as an example of what “actual values” might be, in contrast with “mere behavior”, in order to point out that Eliezer’s “Thou Art Godshatter” argument is not sufficient to show that our values are actually complex.