The simple question is: can this solve easy problems, like getting an AI to correctly count letters, reverse strings, etc.? Does this improve it’s results on an IQ test like https://trackingai.org/IQ-Test-Viewer?
“Creative” doesn’t mean “more accurate”, but you can still test that too: is it writing better fiction than you normally get from those models? Do you have a story you’d be confident posting?
The simple question is: can this solve easy problems, like getting an AI to correctly count letters, reverse strings, etc.? Does this improve it’s results on an IQ test like https://trackingai.org/IQ-Test-Viewer?
“Creative” doesn’t mean “more accurate”, but you can still test that too: is it writing better fiction than you normally get from those models? Do you have a story you’d be confident posting?