JD Pressman: The sentence P is malformed and evokes a variety of different things to different people. I refuse to talk about P, unless I can do so at length. Sociologically, there are seven things P evokes, with P1 actually being desirable in many cases for many people, but it freaks the muggles out. P7 is something we shouldn’t talk about for memetic reasons. P2, P3, P4, and P5 are quite reasonable, and only Nick Bostrom takes P6 seriously. Eliezer is very afraid of P5, and my spicy take is that P4 is similar and worth the chance of making it true on purpose even if that risks P5, if P5 is otherwise inevitable. I’m not going to talk much about P3 or P2. Only weirdos take such practical concerns seriously.
JD Pressman: The sentence P is malformed and evokes a variety of different things to different people. I refuse to talk about P, unless I can do so at length. Sociologically, there are seven things P evokes, with P1 actually being desirable in many cases for many people, but it freaks the muggles out. P7 is something we shouldn’t talk about for memetic reasons. P2, P3, P4, and P5 are quite reasonable, and only Nick Bostrom takes P6 seriously. Eliezer is very afraid of P5, and my spicy take is that P4 is similar and worth the chance of making it true on purpose even if that risks P5, if P5 is otherwise inevitable. I’m not going to talk much about P3 or P2. Only weirdos take such practical concerns seriously.