An AI that can simulate the outcome of human conscious deliberation, without actually instantiating a human consciousness, i.e. a detailed technical understanding of the problem of conscious experience
Could you clarify for me what you mean by requiring that that a human consciousness be instantiated? Is it that you don’t believe it is possible to elicit a CEV from a human if instantiation is involved or that you object to the consequences of simulating human consciousnesses in potentially undesirable situations?
In the case of the latter I observe that this is only a problem under certain CEVs and so is somewhat different in nature to the other requirements. Some people’s CEVs could then be extracted more easily than others.
Could you clarify for me what you mean by requiring that that a human consciousness be instantiated? Is it that you don’t believe it is possible to elicit a CEV from a human if instantiation is involved or that you object to the consequences of simulating human consciousnesses in potentially undesirable situations?
In the case of the latter I observe that this is only a problem under certain CEVs and so is somewhat different in nature to the other requirements. Some people’s CEVs could then be extracted more easily than others.