Curious what your reaction to the argument that SPS and SFO more broadly may be dual use in a way that makes it counterproductive. Do you find it plausible that leaning into this research program could end up making (potentially misaligned) agents more capable at coding tasks (which would increase their ability to get stuff done in general)?
I am concerned about this, and I am also a bit defeatist about timelines for AI “solving” SWE … not sure how to balance these things. I think my loose intuition, which I am open to changing, is that AI will get superhuman at SWE in less than 2 years (maybe much less) and it’s unclear if they’ll be any good at formal methods on such a timeline, so I may as well push for FM so we have some possibility of control via formalism. However, I may be disastrously wrong here and invite any argument to the contrary ..
Curious what your reaction to the argument that SPS and SFO more broadly may be dual use in a way that makes it counterproductive. Do you find it plausible that leaning into this research program could end up making (potentially misaligned) agents more capable at coding tasks (which would increase their ability to get stuff done in general)?
I am concerned about this, and I am also a bit defeatist about timelines for AI “solving” SWE … not sure how to balance these things. I think my loose intuition, which I am open to changing, is that AI will get superhuman at SWE in less than 2 years (maybe much less) and it’s unclear if they’ll be any good at formal methods on such a timeline, so I may as well push for FM so we have some possibility of control via formalism. However, I may be disastrously wrong here and invite any argument to the contrary ..