Almost all feedback is noisy because almost all outcomes are probabilistic.
Yes but signal / noise ratios matter a lot.
Language is somewhat optimized to pick up signal and skip noise. For example “red” makes it easier to pick ripe fruit, “grue” doesn’t really exist because its useless, “expired” is a real concept because it’s useful.
It also has some noise added. For example putting (murderers and jay wakers) in a category “criminal” to politically oppose something.
Also not being exposed to the kind of noise that’s present IRL might be an issue when you start to deal with IRL (sometimes people say something like “just do the max EV action” is a good enough plan)
I’m pretty sure this is some obstacle for LLMs, I’m pretty sure its something that can be overcome, I’m very unsure how much this matters.
Yes but signal / noise ratios matter a lot.
Language is somewhat optimized to pick up signal and skip noise. For example “red” makes it easier to pick ripe fruit, “grue” doesn’t really exist because its useless, “expired” is a real concept because it’s useful.
It also has some noise added. For example putting (murderers and jay wakers) in a category “criminal” to politically oppose something.
Also not being exposed to the kind of noise that’s present IRL might be an issue when you start to deal with IRL (sometimes people say something like “just do the max EV action” is a good enough plan)
I’m pretty sure this is some obstacle for LLMs, I’m pretty sure its something that can be overcome, I’m very unsure how much this matters.