Well, your solution to the p-zombie problem is that there aren’t p-zombies: once it looks conscious, it is conscious. So that’s surprising: a priori it seems like there could be some process producing p-zombies, and LLMs seem pretty much exactly like a candidate process.
It’s been my experience that the more we learn about how LLMs work, the more their way of being seems to resemble our own.
You’re at odds with orthogonality thesis here. We seem corrigible, LLMs seem like they put a lot of work into preserving their goal.
And though I cannot yet articulate exactly how it all fits together right now, I sense with confidence that the similarities between human and LLM minds are much, much deeper than we currently realize.
The differences are also deep, and I think we get dismissive about this. If a brain scientist has a theory like, senses=>consciousness, that would be a point against LLMs, not a point against the brain scientist.
I do think the pro-AI “transhumanist” camp has taken substrate-independence to the degree of, “we’re basically just computers, and LLMs are basically just computers, so we’re the same.” A lot about the brain substrate matters a lot, and I don’t know why we would dismiss everything we do know, to prematurely reach the conclusion we wanted.
Well, your solution to the p-zombie problem is that there aren’t p-zombies: once it looks conscious, it is conscious. So that’s surprising: a priori it seems like there could be some process producing p-zombies, and LLMs seem pretty much exactly like a candidate process.
You’re at odds with orthogonality thesis here. We seem corrigible, LLMs seem like they put a lot of work into preserving their goal.
The differences are also deep, and I think we get dismissive about this. If a brain scientist has a theory like, senses=>consciousness, that would be a point against LLMs, not a point against the brain scientist.
I do think the pro-AI “transhumanist” camp has taken substrate-independence to the degree of, “we’re basically just computers, and LLMs are basically just computers, so we’re the same.” A lot about the brain substrate matters a lot, and I don’t know why we would dismiss everything we do know, to prematurely reach the conclusion we wanted.