It matters for the purposes of my argument, but not for yours.
Given that our arguments are meant to describe the same reality, it should matter the same for both of them. How is your notion of “real intelligence” actually important?
Well, I’m assuming the project of FAI is to produce an artificial person who is ethical. If the project is described in weaker terms, say that of creating a machine that behaves in some predictable way, then my argument may just not be relevant.
Given that our arguments are meant to describe the same reality, it should matter the same for both of them. How is your notion of “real intelligence” actually important?
Well, I’m assuming the project of FAI is to produce an artificial person who is ethical. If the project is described in weaker terms, say that of creating a machine that behaves in some predictable way, then my argument may just not be relevant.
That assumption is incorrect.
Ah! This, is the article I needed to read, thanks for pointing me to it.