The truly arbitrary version seems provably impossible. For example, what if you’re trying to make a smiley face, but some other part of the world contains an agent just like you except they’re trying to make a frowny face—you obviously both can’t succeed. Instead you need some special environment with low entropy, just like humans do in real life.
Yeah absolutely—see third bullet in the appendix. One way to resolve this would be to say that to succeed at answering the control question you have to succeed in at least 1% of randomly chosen environments.
The truly arbitrary version seems provably impossible. For example, what if you’re trying to make a smiley face, but some other part of the world contains an agent just like you except they’re trying to make a frowny face—you obviously both can’t succeed. Instead you need some special environment with low entropy, just like humans do in real life.
Yeah absolutely—see third bullet in the appendix. One way to resolve this would be to say that to succeed at answering the control question you have to succeed in at least 1% of randomly chosen environments.
Unlike our universe, game of life is not reversible, so I don’t think entropy is the key.