I agree that 68% and 45% accuracy are terrible, especially on a 50 word vocabulary. The 68% figure was to contextualize the 45% anticipatory accuracy; to show that anticipation doesn’t cause a dramatic accuracy hit, per your original comment.
Then we see that improved methods at 256-electrode resolution (second study) brings accuracy up to ~76% at 125,000 word vocabulary.
So what I’m extrapolating from this is that, given 2023 SOTA, anticipatory accuracy on ~125,000 word decoding should be ~60-75%. I don’t see why having even a mere hundred times the resolution should get less than 95% accuracy on priors?
Also, the study had a small *test* set, but that’s not the same as *training* on only 10 phrases. Very different statements about underlying capacity.
I agree that 68% and 45% accuracy are terrible, especially on a 50 word vocabulary. The 68% figure was to contextualize the 45% anticipatory accuracy; to show that anticipation doesn’t cause a dramatic accuracy hit, per your original comment.
Then we see that improved methods at 256-electrode resolution (second study) brings accuracy up to ~76% at 125,000 word vocabulary.
So what I’m extrapolating from this is that, given 2023 SOTA, anticipatory accuracy on ~125,000 word decoding should be ~60-75%. I don’t see why having even a mere hundred times the resolution should get less than 95% accuracy on priors?
Also, the study had a small *test* set, but that’s not the same as *training* on only 10 phrases. Very different statements about underlying capacity.