Try playing the GPTs at rock paper scissors just keep saying rock they almost always flip flop back and forth between scissors and paper (occasionally throwing in a rock of their own) they don’t learn any strategy that if you are always saying rock it might be worth them sticking to paper
Also ask them to prove they are playing properly by pre calculating their move not just reacting to what you have written.
The argument about progress always gets me. But think of previous progress. The printing press, the internet etc. etc.
You know what separates these from what we are willingly trying to build.
They are 100% human controlled and understood how they work.
If we build true AGI why are we so naive to think it will want to work for us 🤣