Holden Karnofsky thinks superintelligences with utility functions are made out of programs that list options by rank without making any sort of value judgement (basically answer a question), and then pick the one with the most utility.
Isn’t ‘listing by rank’ ‘making a (value) judgement’?
Isn’t ‘listing by rank’ ‘making a (value) judgement’?