I just see it as a technological fact that it is very possible to build an AI which exerts economic dominance by just assembling existing puzzle pieces. With just a little bit of development effort, AI will be able to run an entire business, make money and then do stuff with that money. And this AI can then easily spiral into becoming autonomous and then god knows what it’ll do with all the money (i.e. power) it will then have.
Be realistic: Shutting down all AI research will never happen. You can advocate for it as much as you want, but Pandora’s Box has been opened. We don’t have time to wait until “humanity figures out alignment”, because by then we’ll all be enslaved by AGI. If we don’t make the first step in building it, someone else will.
I’m not saying that I know how to do it well.
I just see it as a technological fact that it is very possible to build an AI which exerts economic dominance by just assembling existing puzzle pieces. With just a little bit of development effort, AI will be able to run an entire business, make money and then do stuff with that money. And this AI can then easily spiral into becoming autonomous and then god knows what it’ll do with all the money (i.e. power) it will then have.
Be realistic: Shutting down all AI research will never happen. You can advocate for it as much as you want, but Pandora’s Box has been opened. We don’t have time to wait until “humanity figures out alignment”, because by then we’ll all be enslaved by AGI. If we don’t make the first step in building it, someone else will.