In fact, I have a good analogy for the naming problem that Eliezer has created: suppose we are physicists and we are trying to work out how fast light travels through free space. We take measurements of distance and time between various locations, and decide to denote the average of these measurements by the symbol “c”.
Eliezer decides to start using the symbol “c” to denote the real number 3*10^8.
Ben Jones then asks whether c might actually equal 2*10^8.
Others asked whether c might equal 299,792 ,458. No! Of course it doesn’t, says Eliezer: c is defined to be 300,000,000.
“c”—“right”
“300,000,000”—“the output of the CEV algorithm”/”the average human moral viewpoint”
In fact, I have a good analogy for the naming problem that Eliezer has created: suppose we are physicists and we are trying to work out how fast light travels through free space. We take measurements of distance and time between various locations, and decide to denote the average of these measurements by the symbol “c”.
Eliezer decides to start using the symbol “c” to denote the real number 3*10^8.
Ben Jones then asks whether c might actually equal 2*10^8.
Others asked whether c might equal 299,792 ,458. No! Of course it doesn’t, says Eliezer: c is defined to be 300,000,000.
“c”—“right” “300,000,000”—“the output of the CEV algorithm”/”the average human moral viewpoint”