I can see what you mean. However, I would say that just claiming “that’s not what we are trying to do” is not a strong rebuttal. For example, we would not accept such a rebuttal from a weapons company, which was seeking to make weapons technology widely available without regulation. We would say—it doesn’t matter how you are trying to use the weapons, it matters how others are, with your technology.
In the long term, it does seem correct to me that the greater concern is issues around superintelligence. However, in the near term it seems the issue is we are making things that are not at all superintelligent, and that’s the problem. Smart at coding and language, but coupled e.g. with a crude directive to ‘make me as much money as possible,’ with no advanced machinery for ethics or value judgement.
I can see what you mean. However, I would say that just claiming “that’s not what we are trying to do” is not a strong rebuttal. For example, we would not accept such a rebuttal from a weapons company, which was seeking to make weapons technology widely available without regulation. We would say—it doesn’t matter how you are trying to use the weapons, it matters how others are, with your technology.
In the long term, it does seem correct to me that the greater concern is issues around superintelligence. However, in the near term it seems the issue is we are making things that are not at all superintelligent, and that’s the problem. Smart at coding and language, but coupled e.g. with a crude directive to ‘make me as much money as possible,’ with no advanced machinery for ethics or value judgement.