Something like this possibility occurred to me, but I don’t think this actually is better.
At least, I think I’d have to be walked through the reasoning, since right now I THINK I’d prefer Last Tears to Sacrificial Fire, conditioned on, well, the conditions I list in this comment holding.
ie, giving up pain/suffering in a non wireheading way, and being altered to want to eat non-and-never-have-been-conscious “pre humans” really doesn’t seem all that bad to me, compared to the combined costs of defecting in single iteration PD (again, same ole metarationality arguments hold, especially when we imagine future different species we may encounter) + slaughter of everyone unable to escape from Huygens in time + (and I’m thinking this part is really important) missing out on all the wonderful complexities of interaction with the updated versions of the Babyeaters and the Superhappies.
Heck, the giving up pain/suffering thing in a non wireheading or otherwise-screw-us-up may actually be a right and proper thing. I’m not entirely sure on this, though. As I’ve said elsewhere, main reason I’d want to keep it is simply a vague notion of not wanting to give up, well, any capability I have currently + want to be able to retain the ability to at least decode/comprehend my old memories.
I mean, I guess I get the idea of “our values are, well, our values, so according to them, maintaining those values is right”, but… it sure seems to me that those very same values are telling me “Last Tears” has a higher preference ranking than this does.
Something like this possibility occurred to me, but I don’t think this actually is better.
At least, I think I’d have to be walked through the reasoning, since right now I THINK I’d prefer Last Tears to Sacrificial Fire, conditioned on, well, the conditions I list in this comment holding.
ie, giving up pain/suffering in a non wireheading way, and being altered to want to eat non-and-never-have-been-conscious “pre humans” really doesn’t seem all that bad to me, compared to the combined costs of defecting in single iteration PD (again, same ole metarationality arguments hold, especially when we imagine future different species we may encounter) + slaughter of everyone unable to escape from Huygens in time + (and I’m thinking this part is really important) missing out on all the wonderful complexities of interaction with the updated versions of the Babyeaters and the Superhappies.
Heck, the giving up pain/suffering thing in a non wireheading or otherwise-screw-us-up may actually be a right and proper thing. I’m not entirely sure on this, though. As I’ve said elsewhere, main reason I’d want to keep it is simply a vague notion of not wanting to give up, well, any capability I have currently + want to be able to retain the ability to at least decode/comprehend my old memories.
I mean, I guess I get the idea of “our values are, well, our values, so according to them, maintaining those values is right”, but… it sure seems to me that those very same values are telling me “Last Tears” has a higher preference ranking than this does.