That is OK. I think it is a valid question to ask how we will align armies of agents, and as I point out in the post, I actually agree it’s not solved. I believe that there is some level of alignment we will get by having each one of the 100K researchers be aligned, and having aligned monitors etc.., but I also believe in “more is different” and that we will need to invest in explicit alignment methods for the multi-agent setting that are not focused on just model behavior on one prompt in isolation.
That is OK. I think it is a valid question to ask how we will align armies of agents, and as I point out in the post, I actually agree it’s not solved. I believe that there is some level of alignment we will get by having each one of the 100K researchers be aligned, and having aligned monitors etc.., but I also believe in “more is different” and that we will need to invest in explicit alignment methods for the multi-agent setting that are not focused on just model behavior on one prompt in isolation.