Np! Also, just going through the rest of the proposals in my 11 proposals paper, I’m realizing that a lot of the other proposals also try to avoid a full agency hand-off. STEM AI restricts the AI’s agency to just STEM problems, narrow reward modeling restricts individual AIs to only apply their agency to narrow domains, and the amplification and debate proposals are trying to build corrigible question-answering systems rather than do a full agency hand-off.
Thanks for this
Np! Also, just going through the rest of the proposals in my 11 proposals paper, I’m realizing that a lot of the other proposals also try to avoid a full agency hand-off. STEM AI restricts the AI’s agency to just STEM problems, narrow reward modeling restricts individual AIs to only apply their agency to narrow domains, and the amplification and debate proposals are trying to build corrigible question-answering systems rather than do a full agency hand-off.