(Just noting that I agree with your footnote that the learning part is the hard part; that’s the part that seems necessary for real minds, and that, when I ask neuro people about it, they’re like “oh yeah, we don’t know how to do that”.)
I do wonder how behaviorally similar a synapse-frozen human brain emulation would be to a weight-frozen LLM.
I can’t say for sure but a (really interesting) worst case scenario is this guy with a 7 second memory:
Wouldn’t this be analogous to a LLM with a very tiny context window in addition to frozen weights?
(Just noting that I agree with your footnote that the learning part is the hard part; that’s the part that seems necessary for real minds, and that, when I ask neuro people about it, they’re like “oh yeah, we don’t know how to do that”.)
I do wonder how behaviorally similar a synapse-frozen human brain emulation would be to a weight-frozen LLM.
I can’t say for sure but a (really interesting) worst case scenario is this guy with a 7 second memory:
Wouldn’t this be analogous to a LLM with a very tiny context window in addition to frozen weights?