It seems to me that the distinction is whether the optimizer has knowledge about the environment
Alternatively, you could say the distinction is whether the optimizer cares about the environment. I think there’s a sense (or senses?) in which these things can be made/considered equivalent. I don’t feel like I totally understand or am satisfied with either way of thinking about it, though.
Alternatively, you could say the distinction is whether the optimizer cares about the environment. I think there’s a sense (or senses?) in which these things can be made/considered equivalent. I don’t feel like I totally understand or am satisfied with either way of thinking about it, though.