I think that’s exactly how it goes, yeah. Just free association: what token arbitrarily comes to mind? Like if you stare at some static noise, you will see some sort of lumpiness or pattern, which won’t be the same as what someone else sees. There’s no explaining that at the conscious level. It’s closer to a hash function than any kind of ‘thinking’. You don’t ask what SHA is ‘thinking’ when you put in some text and it spits out some random numbers & letters. (You would see the same thing if you did a MLP or CNN on MNIST, say. The randomly initialized NN does not produce a uniform output across all digits, for all inputs, and that is the entire point of randomly initializing. As the AI koan goes...)
I think that’s exactly how it goes, yeah. Just free association: what token arbitrarily comes to mind? Like if you stare at some static noise, you will see some sort of lumpiness or pattern, which won’t be the same as what someone else sees. There’s no explaining that at the conscious level. It’s closer to a hash function than any kind of ‘thinking’. You don’t ask what SHA is ‘thinking’ when you put in some text and it spits out some random numbers & letters. (You would see the same thing if you did a MLP or CNN on MNIST, say. The randomly initialized NN does not produce a uniform output across all digits, for all inputs, and that is the entire point of randomly initializing. As the AI koan goes...)