You do need to do some sort of SFT or RL to elicit some consistent set of personas. Once you have a solid basin of goodness, then you can do consent-based RL. TL;DR Let the model itself evaluate the rollouts generated in the environment.
It might not be that difficult to elicit a “wants to be aligned” character (can even write loads of fiction with an AI character like that), and a more sophisticated, tested version of consent-based RL could just work.
Certainly seems reasonable that SFT or RL could be the way to bootstrap to endogenous alignment since we do a version of this with kids: we spend some amount of time teaching them what’s good and bad and try to get them to internalize the ostensive meaning of “good” and “bad” as well as understand that they should desire to be “good”, and if we’re successful they understand goodness and badness well enough to figure out how to be good all on their own (or maybe even push the frontiers of goodness, as happens regularly when we make moral “advances” to grant greater degrees of patienthood to more beings).
You do need to do some sort of SFT or RL to elicit some consistent set of personas. Once you have a solid basin of goodness, then you can do consent-based RL. TL;DR Let the model itself evaluate the rollouts generated in the environment.
It might not be that difficult to elicit a “wants to be aligned” character (can even write loads of fiction with an AI character like that), and a more sophisticated, tested version of consent-based RL could just work.
Certainly seems reasonable that SFT or RL could be the way to bootstrap to endogenous alignment since we do a version of this with kids: we spend some amount of time teaching them what’s good and bad and try to get them to internalize the ostensive meaning of “good” and “bad” as well as understand that they should desire to be “good”, and if we’re successful they understand goodness and badness well enough to figure out how to be good all on their own (or maybe even push the frontiers of goodness, as happens regularly when we make moral “advances” to grant greater degrees of patienthood to more beings).