This would be cool, but also, I think it would be good if companies just provided access to partially available models (like Mythos) to reputable independent safety researchers. I don’t really see any reason why METR/Redwood/various smaller safety orgs and academic groups shouldn’t get access if it’s already being widely used by corporations for cyberdefense. I guess the only risk is they might find an issue with the model (e.g. along the lines of Ryan Greenblatt’s misalignment issues with previous claude models) and write about it, embarrassing Anthropic, but you could just offer access to the model in exchange for an NDA on discussion of it (there already seem to be restrictions on talking about Mythos). This would obviously not be great but is probably better than the alternative of the only AI safety researchers with access to the real frontier models being those who work for labs.
This would be cool, but also, I think it would be good if companies just provided access to partially available models (like Mythos) to reputable independent safety researchers. I don’t really see any reason why METR/Redwood/various smaller safety orgs and academic groups shouldn’t get access if it’s already being widely used by corporations for cyberdefense. I guess the only risk is they might find an issue with the model (e.g. along the lines of Ryan Greenblatt’s misalignment issues with previous claude models) and write about it, embarrassing Anthropic, but you could just offer access to the model in exchange for an NDA on discussion of it (there already seem to be restrictions on talking about Mythos). This would obviously not be great but is probably better than the alternative of the only AI safety researchers with access to the real frontier models being those who work for labs.