Ah ok. I was assuming that if a singularity occurred it’d be beyond our control, and that our fate would be determined by how the AI was originally programmed. But my reason for assuming this is based on much limited information, so I don’t really know. If it were the case that people with political power control AI, then I think that you are very right.
But if you’re right and we live in a society where there is ASI level power that is controlled by people with political power… that really really scares me. My intuition is that it’d be just a matter of time before someone screws up. I’m not sure what to think of this...
Ah ok. I was assuming that if a singularity occurred it’d be beyond our control, and that our fate would be determined by how the AI was originally programmed. But my reason for assuming this is based on much limited information, so I don’t really know. If it were the case that people with political power control AI, then I think that you are very right.
But if you’re right and we live in a society where there is ASI level power that is controlled by people with political power… that really really scares me. My intuition is that it’d be just a matter of time before someone screws up. I’m not sure what to think of this...