“AI is not rationality. AI is machine learning. Just call it what it is.”
If we take GPT3 as an example ChatGPT is able to multiply two four-digit numbers while earlier versions of GPT3 didn’t.
The way ChatGPT is able to do that is to automatically go into thinking through the multiplication step by step instead of trusting its “intuition”.
That’s very similar to how a human needs to think through this multiplication step-by-step to get the right answer.
I don’t know exactly how they did it, but I think there’s a good chance that they provided it a lot of relevant training data that suggests this reasoning heuristic when asked to multiply two four-digit numbers.
When it comes to moving from the current ChatGPT capabilities to new capabilities I would expect that a good portion of the work is to think about what heuristics it should use to face new problems and then create training data that demonstrate those heuristics.
This way of thinking about what heuristics should be used is the topic of rationality. Some rationality topics are specific to human minds but plenty is more general and also important for AI.
If we take GPT3 as an example ChatGPT is able to multiply two four-digit numbers while earlier versions of GPT3 didn’t.
The way ChatGPT is able to do that is to automatically go into thinking through the multiplication step by step instead of trusting its “intuition”.
That’s very similar to how a human needs to think through this multiplication step-by-step to get the right answer.
I don’t know exactly how they did it, but I think there’s a good chance that they provided it a lot of relevant training data that suggests this reasoning heuristic when asked to multiply two four-digit numbers.
When it comes to moving from the current ChatGPT capabilities to new capabilities I would expect that a good portion of the work is to think about what heuristics it should use to face new problems and then create training data that demonstrate those heuristics.
This way of thinking about what heuristics should be used is the topic of rationality. Some rationality topics are specific to human minds but plenty is more general and also important for AI.