I suspect much of the reason we didn’t need much long term memory is that we can increase the context window pretty cheaply, thus long-term memory is deprioritized.
I suspect much of the reason we didn’t need much long term memory is that we can increase the context window pretty cheaply, thus long-term memory is deprioritized.