I also tried my hand at determining the human values, but produced a different result with an implication of what the AIs should be aligned to. My take had human collectives want to preserve themselves and the skills which most of the collective’s members have and to avoid outsourcing-induced loss of skills. In this case the role of the AIs would be severely reduced (to teachers and protectors, perhaps?)
An interesting read, thanks for the link. I think your analysis is more at a sociological level — which builds on top of the evolutionary viewpoint I’m advocating for here. Evolutionary psychology suggests why certain types of memes propagate, sociology studies what happen when they do. I would expect that completing Value Learning would require making a great deal of progress in all the “Soft Sciences”. On the specific idea of avoiding loss of skills, I suspect you are being a little optimistic (after decades of calculators, relatively few people can still do long division), but this does seem related to the idea of avoiding loss of optionalty I mention briefly above.
I also tried my hand at determining the human values, but produced a different result with an implication of what the AIs should be aligned to. My take had human collectives want to preserve themselves and the skills which most of the collective’s members have and to avoid outsourcing-induced loss of skills. In this case the role of the AIs would be severely reduced (to teachers and protectors, perhaps?)
An interesting read, thanks for the link. I think your analysis is more at a sociological level — which builds on top of the evolutionary viewpoint I’m advocating for here. Evolutionary psychology suggests why certain types of memes propagate, sociology studies what happen when they do. I would expect that completing Value Learning would require making a great deal of progress in all the “Soft Sciences”. On the specific idea of avoiding loss of skills, I suspect you are being a little optimistic (after decades of calculators, relatively few people can still do long division), but this does seem related to the idea of avoiding loss of optionalty I mention briefly above.