FWIW, I think a better question to ask within this area might be if we can retain a meta-process rather than a specific value.
You don’t want to leave your footprint on the future so then why are we talking about having a specific goal such as IGF specified? Wouldn’t it make more sense to talk about the characteristics of the general process of proxy goal evolution for IGF instead? I think this would better reflect something that is closer to a long reflection and to some extent I think that is what we should be aiming for.
Other than that I like the concept of “slack” when looking at the divergence of models. If there is no way that humans can do anything else but IGF then they won’t. If they’re given abundance then degrees of freedom arise and divergence is suddenly possible.
FWIW, I think a better question to ask within this area might be if we can retain a meta-process rather than a specific value.
You don’t want to leave your footprint on the future so then why are we talking about having a specific goal such as IGF specified? Wouldn’t it make more sense to talk about the characteristics of the general process of proxy goal evolution for IGF instead? I think this would better reflect something that is closer to a long reflection and to some extent I think that is what we should be aiming for.
Other than that I like the concept of “slack” when looking at the divergence of models. If there is no way that humans can do anything else but IGF then they won’t. If they’re given abundance then degrees of freedom arise and divergence is suddenly possible.