It seems to me that there’s an aspect to this that isn’t getting much attention: the domain.
Example domains include chess and Go, certainly. But probabilistic games surely should not be excluded. There is a spectrum of domains which go from “fair roulette” (which is not manipulatable by intelligence), though blackjack (slightly manipulable), and only at one end reach highly manipulatable games like chess and Go.
I’m sure Eliezer understands this, but his presentation doesn’t spend much time on it.
For example, how do the calculations change when you admit that the domain may make some desirable situations impossible?
It seems to me that there’s an aspect to this that isn’t getting much attention: the domain.
Example domains include chess and Go, certainly. But probabilistic games surely should not be excluded. There is a spectrum of domains which go from “fair roulette” (which is not manipulatable by intelligence), though blackjack (slightly manipulable), and only at one end reach highly manipulatable games like chess and Go.
I’m sure Eliezer understands this, but his presentation doesn’t spend much time on it.
For example, how do the calculations change when you admit that the domain may make some desirable situations impossible?