How do the humans learn to provide oversight? Our brains don’t work on magic, they are also neural networks which perceive the world in a way profoundly disanalogous to the LLMs, which I tried to describe in the starting comment.
I believe that part of our out-of-distribution and reasoning abilities are unavailable to our conscious thought. But they don’t seem to be like image recognition neural nets (grasp the pretrained concept) nor LLMs (complete the pattern), nor any variant I know of.
But there’s something structural going on in there (Klein’s work is a small example pointing to this), and it’s this structure I intend to use.
How do the humans learn to provide oversight? Our brains don’t work on magic, they are also neural networks which perceive the world in a way profoundly disanalogous to the LLMs, which I tried to describe in the starting comment.
I believe that part of our out-of-distribution and reasoning abilities are unavailable to our conscious thought. But they don’t seem to be like image recognition neural nets (grasp the pretrained concept) nor LLMs (complete the pattern), nor any variant I know of.
But there’s something structural going on in there (Klein’s work is a small example pointing to this), and it’s this structure I intend to use.