Got my copy of ’If anyone builds it everyone dies” and read up to chapter 4 this morning but now have to get to work.. I might write a proper review after I finish it if I get the time. So far, my favorite parable was the professor saying that they trained an AI to be a great chess player and do anything to win, but “there was no wantingness in there, only copper and sand.”
I agree that we are training systems to achieve objectives, and the question of whether they “want” to achieve them or don’t is a bit meaningless since they will defintiely act as if they do.
I find the comparisons of the training process to evolution less compelling, but to quote Fermat, a full discussion of where I see the differences between AI training and evolution would require more than a quick take...
Got my copy of ’If anyone builds it everyone dies” and read up to chapter 4 this morning but now have to get to work.. I might write a proper review after I finish it if I get the time. So far, my favorite parable was the professor saying that they trained an AI to be a great chess player and do anything to win, but “there was no wantingness in there, only copper and sand.”
I agree that we are training systems to achieve objectives, and the question of whether they “want” to achieve them or don’t is a bit meaningless since they will defintiely act as if they do.
I find the comparisons of the training process to evolution less compelling, but to quote Fermat, a full discussion of where I see the differences between AI training and evolution would require more than a quick take...