Let me be the first in this thread to suggest that, for the purposes of GLUTs, we should taboo the word “conscious.” This post, in my opinion, is a shining example of Eliezer’s ability to verbally carve reality at its joints. After a remarkably clear discussion of the real problem, the question of “conscious” GLUTs seems like a silly near-boundary case.
Is there a technical reason I should think otherwise?
I would be interested in covering this on The Cognitive Revolution podcast – please check DMs if interested. :)