Then wouldn’t you believe that in the case of my thought experiment, the number is also smeared through the parameter weights? Or maybe it’s merely the intent to pick a number later that’s smeared through the parameter weights?
Lots of things are smeared through the number weights.
I’ve prompted ChatGPT with “tell me a story” well over a dozen times, independently in separate sessions. On three occasions I’ve gotten a story with elements from “Jack and the beanstalk.” There’s the name, the beanstalk, and the giant. But the giant wasn’t blind and no “fee fi fo fum.” Why that story three times? I figure it’s more or less an arbitrary fact of history and that seems to be particularly salient for ChatGPT.
Then wouldn’t you believe that in the case of my thought experiment, the number is also smeared through the parameter weights? Or maybe it’s merely the intent to pick a number later that’s smeared through the parameter weights?
Lots of things are smeared through the number weights.
I’ve prompted ChatGPT with “tell me a story” well over a dozen times, independently in separate sessions. On three occasions I’ve gotten a story with elements from “Jack and the beanstalk.” There’s the name, the beanstalk, and the giant. But the giant wasn’t blind and no “fee fi fo fum.” Why that story three times? I figure it’s more or less an arbitrary fact of history and that seems to be particularly salient for ChatGPT.