there is no reason for these to have much to do with the circuits (traders) which simulate a human writing a fictional superintelligence.
I agree that there’s no reliable reason, such that we should expect anything positive to reliably come from that generalization. But I don’t buy that there’s no reason or that it won’t happen, I just don’t expect it to happen enough for persona research to extend the horizon of alignment reliability enough to matter once the horizon of causal impact per thought has become enormous.
I agree that there’s no reliable reason, such that we should expect anything positive to reliably come from that generalization. But I don’t buy that there’s no reason or that it won’t happen, I just don’t expect it to happen enough for persona research to extend the horizon of alignment reliability enough to matter once the horizon of causal impact per thought has become enormous.