Unknown:
If it understood that it was deterministic, then it would also understand that it only one of X or Y was possible. It would NOT see X and Y as merely possibilities it has ‘not yet’ decided between. it would KNOW it is impossible for it to make one of the choices.
Your argument seems to rest on the AI rejecting the proof because of stubbornness about what it thinks it has decided. Your argument doesn’t rest on the AI finding an actual flaw in the proof, or there being an actual flaw in the proof. I don’t think that this is a good argument for such a proof being impossible.
If we write an AI and on pure whimsy include the line:
if input=”tickle” then print “hahaha”;
then on examining it source code it will conclude that it would print hahaha if we typed in tickle. It would not say “Oh, but I haven’t DECIDED to print hahaha yet.”
Unknown: If it understood that it was deterministic, then it would also understand that it only one of X or Y was possible. It would NOT see X and Y as merely possibilities it has ‘not yet’ decided between. it would KNOW it is impossible for it to make one of the choices.
Your argument seems to rest on the AI rejecting the proof because of stubbornness about what it thinks it has decided. Your argument doesn’t rest on the AI finding an actual flaw in the proof, or there being an actual flaw in the proof. I don’t think that this is a good argument for such a proof being impossible.
If we write an AI and on pure whimsy include the line: if input=”tickle” then print “hahaha”;
then on examining it source code it will conclude that it would print hahaha if we typed in tickle. It would not say “Oh, but I haven’t DECIDED to print hahaha yet.”