Tyrrell: Agreed. As I said in what, well, I said, my acceptance of the SuperHappy bargain was conditional in part on, well, the change being engineered in such a way that it doesn’t make the rest of our cognitive structure, values, etc go kablewey. But, given that the changes are as advertised, and there aren’t hidden surprises of the “if I really thought through where this would lead, I’d see this is very very bad” variety, well, sure seems to me that the choice in this ending is the wrong one.
Nick: And to we really want, in general, defection to be the norm? ie, when we next meet up with a different species? ie, by the same ole metarationality arguments (ie, blah blah, it’s not us causing their behavior, but common cause leading to both, our choices arise from algorithms/causality, yada yada yada yada) it would seem that now humanity ought to expect there to be more PD defectors in the universe than previously thought. I think...
Tyrrell: Agreed. As I said in what, well, I said, my acceptance of the SuperHappy bargain was conditional in part on, well, the change being engineered in such a way that it doesn’t make the rest of our cognitive structure, values, etc go kablewey. But, given that the changes are as advertised, and there aren’t hidden surprises of the “if I really thought through where this would lead, I’d see this is very very bad” variety, well, sure seems to me that the choice in this ending is the wrong one.
Nick: And to we really want, in general, defection to be the norm? ie, when we next meet up with a different species? ie, by the same ole metarationality arguments (ie, blah blah, it’s not us causing their behavior, but common cause leading to both, our choices arise from algorithms/causality, yada yada yada yada) it would seem that now humanity ought to expect there to be more PD defectors in the universe than previously thought. I think...
This would be a bad thing.