OK, thanks for explanation. The part about avoiding memetic hazards… seems like a valuable thing to do, but also seems to me that in practice most attempts to avoid memetic hazards have second-order effects. (Obvious counter-argument: if there are successful cases of avoiding memetic hazards that do not have side effects, I would probably not know about them. An important part of keeping a secret is never mentioning that there is a secret.)
But this would be a debate for another day. Maybe an entire field of research: how to communicate infohazards. (If you found it, there is a chance other people will, too. How can you decrease that probability, without doing things that will likely blow back later.)
In the meanwhile, if in most cases the accurate thing is the useful thing, and if we don’t know how to handle the remaining cases, I feel okay going for the accurate thing. (This is probably easier for me, because I personally don’t do anything important on a large scale, so I don’t have to worry about accidentally destroying humanity.)
OK, thanks for explanation. The part about avoiding memetic hazards… seems like a valuable thing to do, but also seems to me that in practice most attempts to avoid memetic hazards have second-order effects. (Obvious counter-argument: if there are successful cases of avoiding memetic hazards that do not have side effects, I would probably not know about them. An important part of keeping a secret is never mentioning that there is a secret.)
But this would be a debate for another day. Maybe an entire field of research: how to communicate infohazards. (If you found it, there is a chance other people will, too. How can you decrease that probability, without doing things that will likely blow back later.)
In the meanwhile, if in most cases the accurate thing is the useful thing, and if we don’t know how to handle the remaining cases, I feel okay going for the accurate thing. (This is probably easier for me, because I personally don’t do anything important on a large scale, so I don’t have to worry about accidentally destroying humanity.)