I think both of these camps are seeing real things. I think:
We should not race to superintelligence because we’re not prepared to have a reasonable chance of surviving AND It’s extremely hard to stop due to underlying dynamics of civilization (competitive dynamics, moloch, etc)
We should try to stop the race, but be clearsighted about the forces we’re up against and devise plans that have a chance of working despite them.
I think both of these camps are seeing real things. I think:
We should try to stop the race, but be clearsighted about the forces we’re up against and devise plans that have a chance of working despite them.