I’m not claiming I know the perfect cut off point between not losing information and not letting errors accumulate, if something like that even exists. It could very well be that after 3 forward passes with neuralese, it would still be mostly fine or it could also be that even in the middle of a single forward pass it makes sense to have some kind of mitigations (I think you could build an argument around MoE being a mitigation). But what this perfect ratio is doesn’t really matter, the point is that recurrent forward passes will be a thousand times worse than a normal forward pass and therefore can’t be worth it anymore.
Making everything discrete is one extreme just as making everything continuous is the other extreme. I’m arguing that the golden ratio lies somewhere in the middle, recognizing the importance of both rich, continuous representations and clear, discrete representations.
I’m not claiming I know the perfect cut off point between not losing information and not letting errors accumulate, if something like that even exists. It could very well be that after 3 forward passes with neuralese, it would still be mostly fine or it could also be that even in the middle of a single forward pass it makes sense to have some kind of mitigations (I think you could build an argument around MoE being a mitigation). But what this perfect ratio is doesn’t really matter, the point is that recurrent forward passes will be a thousand times worse than a normal forward pass and therefore can’t be worth it anymore.
Making everything discrete is one extreme just as making everything continuous is the other extreme. I’m arguing that the golden ratio lies somewhere in the middle, recognizing the importance of both rich, continuous representations and clear, discrete representations.