The application is exceptionally long and annoying
Funny you should say this. As someone used to NIH grant applications (which can be over 100 pages long, full of mostly-boilerplate), I thought it was a lot easier in comparison! But SFF could definitely be improved. As it is, there’s a lot of near-duplicate questions.
Holy crap. If AI leaders don’t learn from this we’re all doomed.
(Also why are these evals not running on an airgapped system? That would make sense if you’re taking off the safety guardrails but of course a sufficiently powerful AI may be able to exfiltrate anyway.)