I mean, yes, a company self-destructing doesn’t stop much if their knowledge isn’t also actively deleted—and even then, it’s just a setback of a few months. But also, by going “oh well we need to work inside the system to fix it somehow” at some point all you get is just another company racing with all others (and in this case, effectively being a pace setter). However you put it, OpenAI is more responsible than any other company for how close we may be to AGI right now, and despite their stated mission, I suspect they did not advance safety nearly as much as capability. So in the end, from the X-risk viewpoint, they mostly made things worse.
I mean, yes, a company self-destructing doesn’t stop much if their knowledge isn’t also actively deleted—and even then, it’s just a setback of a few months. But also, by going “oh well we need to work inside the system to fix it somehow” at some point all you get is just another company racing with all others (and in this case, effectively being a pace setter). However you put it, OpenAI is more responsible than any other company for how close we may be to AGI right now, and despite their stated mission, I suspect they did not advance safety nearly as much as capability. So in the end, from the X-risk viewpoint, they mostly made things worse.