It’s nice to hear that there are at least a few sane people leading these scaling labs. It’s not clear to me that their intentions are going to translate into much because there’s only so much you can do to wisely guide development of this technology within an arms race.
But we could have gotten a lot less lucky with some of the people in charge of this technology.
A more cynical perspective is that much of this arms race, especially the international one against China (quote from above: “If we don’t build fast enough, then the authoritarian countries could win.”), is entirely manufactured by the US AI labs.
Actions speak louder than words, and their actions are far less sane than these words.
For example, if Demis regularly lies awake at night worrying about how the thing he’s building could kill everyone, why is he still putting so much more effort into building it than into making it safe?
Probably because he thinks there’s a lower chance of it killing everyone if he makes it. And that if it doesn’t kill everyone then he’ll do a better job managing it than the other lab heads.
This is the belief of basically everyone running a major AGI lab. Obviously all but one of them must be mistaken, but it’s natural that they would all share the same delusion.
This is the belief of basically everyone running a major AGI lab. Obviously all but one of them must be mistaken, but it’s natural that they would all share the same delusion.
I agree with this description and I don’t think this is sane behavior.
Only the 2nd belief is necessarily wrong for everyone but 1 person, the first belief is not necessarily mistaken, because one of them relates to relative performance, and the other relates to absolute performance.
It’s nice to hear that there are at least a few sane people leading these scaling labs. It’s not clear to me that their intentions are going to translate into much because there’s only so much you can do to wisely guide development of this technology within an arms race.
But we could have gotten a lot less lucky with some of the people in charge of this technology.
A more cynical perspective is that much of this arms race, especially the international one against China (quote from above: “If we don’t build fast enough, then the authoritarian countries could win.”), is entirely manufactured by the US AI labs.
Actions speak louder than words, and their actions are far less sane than these words.
For example, if Demis regularly lies awake at night worrying about how the thing he’s building could kill everyone, why is he still putting so much more effort into building it than into making it safe?
Probably because he thinks there’s a lower chance of it killing everyone if he makes it. And that if it doesn’t kill everyone then he’ll do a better job managing it than the other lab heads.
This is the belief of basically everyone running a major AGI lab. Obviously all but one of them must be mistaken, but it’s natural that they would all share the same delusion.
I agree with this description and I don’t think this is sane behavior.
Only the 2nd belief is necessarily wrong for everyone but 1 person, the first belief is not necessarily mistaken, because one of them relates to relative performance, and the other relates to absolute performance.