On the problem of “aligned to whom”, most societies have a fairly consistent answer to how this works. Capable healthy adults are generally allowed to make their own decisions about their own welfare, except on decisions where their actions might significantly decrease the well-being of others (i.e. your right to swing your fists around however you want ends at my nose). Note that this is (mostly) asymmetric around some ‘default’ utility level: you don’t have the right to hurt me, but you do have the right to choose not to help me. There are exceptions to this simple rule-of-thumb: for example, most societies have tax systems that do some wealth redistribution, so to some extent you are obligated to help the government help me.
By implication, this means you’re allowed to use AI to help yourself any way you like, but you’re not allowed to use it to help you harm me. If you look at the permitted use policies of most AI companies, that’s pretty much what they say.
On the problem of “aligned to whom”, most societies have a fairly consistent answer to how this works. Capable healthy adults are generally allowed to make their own decisions about their own welfare, except on decisions where their actions might significantly decrease the well-being of others (i.e. your right to swing your fists around however you want ends at my nose). Note that this is (mostly) asymmetric around some ‘default’ utility level: you don’t have the right to hurt me, but you do have the right to choose not to help me. There are exceptions to this simple rule-of-thumb: for example, most societies have tax systems that do some wealth redistribution, so to some extent you are obligated to help the government help me.
By implication, this means you’re allowed to use AI to help yourself any way you like, but you’re not allowed to use it to help you harm me. If you look at the permitted use policies of most AI companies, that’s pretty much what they say.