As far as I understand, at least one of the authors has an unusual moral philosophy such as not believing in consciousness or first-person experiences, while simultaneously believing that future AIs are automatically morally worthy simply by having goals.
[narrow point, as I agree with most of the comment]
For what it’s worth, I think this seems to imply that illusionism (roughly, people who, in a meaningful sense, “don’t believe in consciousness”) makes people more inclined to act in ethically deranged ways, but, afaict, this mostly isn’t the case, because I’ve known a few illusionists (was one myself until ~1 year ago) and, afaict, they were all decent people, not less decent than the average of my social surroundings.
To give an example, Dan Dennett was an illusionist and very much not a successionist. Similarly, I wouldn’t expect any successionist aspirations from Keith Frankish.
There are caveats, though in that I do think that a sufficient combination of ideas which are individually fine, even plausibly true (illusionism, moral antirealism, …), and some other stuff (character traits, paycheck, social milieu) can get people into pretty weird moral positions.
[narrow point, as I agree with most of the comment]
For what it’s worth, I think this seems to imply that illusionism (roughly, people who, in a meaningful sense, “don’t believe in consciousness”) makes people more inclined to act in ethically deranged ways, but, afaict, this mostly isn’t the case, because I’ve known a few illusionists (was one myself until ~1 year ago) and, afaict, they were all decent people, not less decent than the average of my social surroundings.
To give an example, Dan Dennett was an illusionist and very much not a successionist. Similarly, I wouldn’t expect any successionist aspirations from Keith Frankish.
There are caveats, though in that I do think that a sufficient combination of ideas which are individually fine, even plausibly true (illusionism, moral antirealism, …), and some other stuff (character traits, paycheck, social milieu) can get people into pretty weird moral positions.