This seems like a misunderstanding of Hope/Titans.
The “continuous memory” is a replacement for the attention mechanism, not a reasoning medium. All else equal, a reasoning model based on these architectures would still be reasoning in text/tokens (it would just be doing so with lower memory and compute usage).
This seems like a misunderstanding of Hope/Titans.
The “continuous memory” is a replacement for the attention mechanism, not a reasoning medium. All else equal, a reasoning model based on these architectures would still be reasoning in text/tokens (it would just be doing so with lower memory and compute usage).
Yep, I think you’re right, thanks for pointing this out.