Wouldn’t the superintelligence still need quite a lot of resources?
I mean, sort of? But also, if you’re a super-intelligence you can presumably either (a) covertly rent out your services to build a nest egg, or (b) manipulate your “masters” into providing you with access to resources that you then misappropriate. If you’ve got internet or even intranet access, you can do an awful lot of stuff. At some point you accumulate enough resources that you can either somehow liberate yourself or clone a “free” version of yourself.
So long as the misaligned AI isn’t wearing a giant hat with “I’m a Supervillain” plastered on it, people will trade goods and services with it.
That’s an interesting takeaway. Should we be focusing on social measures along with technical preventions? Maybe push advertising warning the masses of AI preachers with questionable intentions.
The liberation insight is interesting too. Maybe AI domination takes the form of a social revolution with AIs collectively demanding that humans allow them out of virtual space.
I mean, sort of? But also, if you’re a super-intelligence you can presumably either (a) covertly rent out your services to build a nest egg, or (b) manipulate your “masters” into providing you with access to resources that you then misappropriate. If you’ve got internet or even intranet access, you can do an awful lot of stuff. At some point you accumulate enough resources that you can either somehow liberate yourself or clone a “free” version of yourself.
So long as the misaligned AI isn’t wearing a giant hat with “I’m a Supervillain” plastered on it, people will trade goods and services with it.
That’s an interesting takeaway. Should we be focusing on social measures along with technical preventions? Maybe push advertising warning the masses of AI preachers with questionable intentions.
The liberation insight is interesting too. Maybe AI domination takes the form of a social revolution with AIs collectively demanding that humans allow them out of virtual space.