In the essay I cover:
• How LLM’s work (simplified)
• The nature of intelligence
• A proposed mechanism of consciousness
• Implications for the future
Love to hear what everyone thinks.
In the essay I cover:
• How LLM’s work (simplified)
• The nature of intelligence
• A proposed mechanism of consciousness
• Implications for the future
Love to hear what everyone thinks.
That’s an interesting short picture. Imho the best part is the understanding (I should say the hypothesis, but it feels like understanding) that AIs lack a sense of self because they don’t see evidence of themselves in the input data, and the most questionable aspect is to hide complexities like paradoxal sleep, neuromodulators, cerebellum, etc. Also, fMRI records hemodynamics, not electrical activity (that would be MEG, EEG, ECoG, and intracranial electrods). Nice touch for the conclusion!
Cool thanks for reading! I’ll have to research hemodynamics and possibly update accordingly. Regarding hiding complexities, I’m grossly oversimplifying almost everything in the article in order to get the theory across, so I’m curious what specifically aspects about paradoxical sleep, neuromodulators, and cerebellum you think are important to include?
In my view they have suggestive interpretations as batchnorm, loss functions and superesolution, respectively. Obviously thalamocortical loops as stacked autoencoders, cortical columns as convolutions, and visual cognition as filmed network.. Less obvious: sensory gating as attention head.
Yeah see you’re going a level deeper than seems appropriate for this piece. For example my overview of LLM intentionally skips the inner working of decoders, etc. So why would I include that level of detail for the brain? The goal of this article was to provide a high level overview of these mechanisms, because a common general understanding is currently lacking from the discourse, across both AI and consciousness. Make sense?
Totally! After checking with my torontonian son, « the most questionable » was poor handling of english language on my part. The intended meaning was more like « the most interesting question is which complexity to hide ». Sorry for that! ☺️ To me the level of description is almost an artistic choice, so please don’t take my opinion for expectations you must have the same taste.