Fascinating! Did you perform this experiment with the chess prompt just now? Is this from a paper you could link to?
What happens if, after it spits out those 34 moves, you ask it for its name?
I think what would happen from the prompt “Can you play chess?\n\nN” is that it would just autocomplete with a plausible interview answer from someone who couldn’t play chess (even though the engine itself clearly can).
It might generate “o, I never learned how as a child, and I’ve been too busy since then, but I’ve always liked the idea of it” or something like that.
The deep claim I’m making here is that the current thing doesn’t do anything remotely like object persistence, especially about itself-as-a-text-engine, and that adding more parameters won’t change this.
But it will be able to write texts portraying people or robots who have, and know they have, object persistence powers inside the stories it generates.
Fascinating! Did you perform this experiment with the chess prompt just now? Is this from a paper you could link to?
What happens if, after it spits out those 34 moves, you ask it for its name?
I think what would happen from the prompt “Can you play chess?\n\nN” is that it would just autocomplete with a plausible interview answer from someone who couldn’t play chess (even though the engine itself clearly can).
It might generate “o, I never learned how as a child, and I’ve been too busy since then, but I’ve always liked the idea of it” or something like that.
The deep claim I’m making here is that the current thing doesn’t do anything remotely like object persistence, especially about itself-as-a-text-engine, and that adding more parameters won’t change this.
But it will be able to write texts portraying people or robots who have, and know they have, object persistence powers inside the stories it generates.