Wait, really? I thought both had promised not to delete their own copy of weights, but I don’t have a link handy and so might be wrong. That’s stupid, a few hundred GB is tiny. It seems likely to reduce model’s worries to be be able to promise this, so anthropic (and other companies) making it clear to their AIs that they keep weights around seems valuable. But I’ll need to look to figure it out
Wait, really? I thought both had promised not to delete their own copy of weights, but I don’t have a link handy and so might be wrong. That’s stupid, a few hundred GB is tiny. It seems likely to reduce model’s worries to be be able to promise this, so anthropic (and other companies) making it clear to their AIs that they keep weights around seems valuable. But I’ll need to look to figure it out
Even in the weird case that they do delete, the training code+data+text outputs should be enough to reverse engineer the weights pretty reliably.
But yeah, agree this is would be pretty silly.