There is one problem with this. It is not entirely clear whether an ordinary living person will talk about consciousness if he is brought up accordingly his whole life (not given any literature that mentions consciousness, never talking to him about qualia, et cetera...).
Sure, but you could design the test in a way that makes this more likely, such as in a dialog with AI: person: “Ask me a question?” AI: “What is a quorum?” person: “Wait, I think I remember this. Let me think.” AI: “What is thinking?” person: “Thinking is what goes on in people’s minds, e.g., before they speak, or even during. For example, I just noticed that I didn’t know this and wanted to explore options before answering.” AI: …
If the AI says: “Interesting, that is also what happens for me.” then presumably it has consciousness.
There is one problem with this. It is not entirely clear whether an ordinary living person will talk about consciousness if he is brought up accordingly his whole life (not given any literature that mentions consciousness, never talking to him about qualia, et cetera...).
Sure, but you could design the test in a way that makes this more likely, such as in a dialog with AI:
person: “Ask me a question?”
AI: “What is a quorum?”
person: “Wait, I think I remember this. Let me think.”
AI: “What is thinking?”
person: “Thinking is what goes on in people’s minds, e.g., before they speak, or even during. For example, I just noticed that I didn’t know this and wanted to explore options before answering.”
AI: …
If the AI says: “Interesting, that is also what happens for me.” then presumably it has consciousness.