Do we know that the improvements in cyberoffense aren’t just downstream of improvements in programming generally? The “it’s mostly pre-training” view admits of a world where enough pre-training on high quality programming generalizes to high level capabilities in various programming tasks, even those with less representation in the training data. Bel was (probably) not trained on a solution to Navier-Stokes, and yet was able to find one anyway.
Do we know that the improvements in cyberoffense aren’t just downstream of improvements in programming generally? The “it’s mostly pre-training” view admits of a world where enough pre-training on high quality programming generalizes to high level capabilities in various programming tasks, even those with less representation in the training data. Bel was (probably) not trained on a solution to Navier-Stokes, and yet was able to find one anyway.