At what level of general intelligence would a chess program start the unbounded optimization of its chess skills?
You have mostly answered it yourself. Never. Or until a motivation for doing so is provided by some external agent. The biological evolution filled our brains with the intelligence AND a will to do such things as not to only win a chess game, but to use the whole Moon to get enough computing power to be nearly an optimal chess player.
Power without control is nothing. Intelligence without motives is also nothing, in that sense.
You have mostly answered it yourself. Never. Or until a motivation for doing so is provided by some external agent. The biological evolution filled our brains with the intelligence AND a will to do such things as not to only win a chess game, but to use the whole Moon to get enough computing power to be nearly an optimal chess player.
Power without control is nothing. Intelligence without motives is also nothing, in that sense.