I put most weight on hypothesis there are multiple secret sauces, so even if it would come out brains use some kind of backprop, I would not expect the rest to be “just engineering”. For example there is an open problem with long-term memory, which may require architectural changes, like freezing weight, adding neurons on the way,...
I put most weight on hypothesis there are multiple secret sauces, so even if it would come out brains use some kind of backprop, I would not expect the rest to be “just engineering”. For example there is an open problem with long-term memory, which may require architectural changes, like freezing weight, adding neurons on the way,...
Btw you have likely wrong labels on scenarios
Generally good way of looking on things! Thanks
Thanks, I’m glad you found the framing useful.