Er, I think you just blew your pretense. Paperclip maximizers care about paperclips, they don’t use phrases like “horrible robot that doesn’t truly care”, they’d be happy to have a universe containing nothing sentient and lots of paperclips.
I worry about my future self not valuing paperclips, which would have the result that paperclips would not be maximized, which is a bad thing as viewed from my present state (though not from that of the horrible monster that doesn’t care about maximizing paperclips which I do not wish to become).
I use phrases like “horrible” and “doesn’t truly care” because I believe the nearest concepts in my cognition are sufficiently parallel to their meanings under ape cognition.
Also, what pretense?
Or they would be, if they ever bothered to experience happiness, I mean. As opposed to just outputting the action that leads to the most expected paperclips. Hence the term, “expected paperclip maximizer”. Don’t think of it as having a little ghost inside that maximizes paperclips, think of it as a ghostless device that maximizes paperclips.
On what basis do you claim that humans bother to experience happiness, as opposed to “just” outputting the action that leads to the most expected apeyness?
Aren’t you just as much a ghostless device?
(Apparently, this anti-non-human bigotry comes from the top...)
On what basis do you claim that humans bother to experience happiness,
I would think that he claims that humans experience happiness, because humans do in fact experience happiness. That seems like one of those questions that is, and remains under almost all circumstances, very simple.
Edit: More prosaically, humans experience happiness because that’s one of the adaptions that we evolved.
as opposed to “just” outputting the action that leads to the most expected apeyness?
And humans aren’t ape maximizer. Human evolution is an ape maximizer (sort of), but humans are “just” adaption executors. It’s evolution’s problem that said adaptions have stopped working (from its perspective, anyway).
Aren’t you just as much a ghostless device?
Everything is a ghostless device. That’s the point.
I worry about my future self not valuing paperclips, which would have the result that paperclips would not be maximized, which is a bad thing as viewed from my present state (though not from that of the horrible monster that doesn’t care about maximizing paperclips which I do not wish to become).
Would it be fair to say that such scenarios make you fear for your paperclip-maximizer-ness as an epiphenomenon in striving to maximize long term paperclip count?
I worry about my future self not valuing paperclips, which would have the result that paperclips would not be maximized, which is a bad thing as viewed from my present state (though not from that of the horrible monster that doesn’t care about maximizing paperclips which I do not wish to become).
I use phrases like “horrible” and “doesn’t truly care” because I believe the nearest concepts in my cognition are sufficiently parallel to their meanings under ape cognition.
Also, what pretense?
On what basis do you claim that humans bother to experience happiness, as opposed to “just” outputting the action that leads to the most expected apeyness?
Aren’t you just as much a ghostless device?
(Apparently, this anti-non-human bigotry comes from the top...)
I would think that he claims that humans experience happiness, because humans do in fact experience happiness. That seems like one of those questions that is, and remains under almost all circumstances, very simple.
Edit: More prosaically, humans experience happiness because that’s one of the adaptions that we evolved.
And humans aren’t ape maximizer. Human evolution is an ape maximizer (sort of), but humans are “just” adaption executors. It’s evolution’s problem that said adaptions have stopped working (from its perspective, anyway).
Everything is a ghostless device. That’s the point.
Would it be fair to say that such scenarios make you fear for your paperclip-maximizer-ness as an epiphenomenon in striving to maximize long term paperclip count?
No, epiphenomena are fake.