Do you think that thoughts are too incentivised or not incentivised enough on the margin, for the purpose of epistemically sound thinking? If they’re too incentivised, have you considered dampening LWs karma system? If they’re not incentivised enough, what makes you believe that legalising blackmail will worsen the epistemic quality of thoughts?
The LW karma obviously has its flaws, per Goodhart’s law. It is used anyway, because the alternative is having other problems, and for the moment this seems like a reasonable trade-off.
The punishment for “heresies” is actually very mild. As long as one posts respected content in general, posting a “heretical” comment every now and then does not ruin their karma. (Compare to people having their lives changed dramatically because of one tweet.) The punishment accumulates mostly for people whose only purpose here is to post “heresies”. Also, LW karma does not prevent anyone from posting “heresies” on a different website. Thus, people can keep positive LW karma even if their main topic is talking how LW is fundamentally wrong as long as they can avoid being annoying (for example by posting hundred LW-critical posts on their personal website, posting a short summary with hyperlinks on LW, and afterwards using LW mostly to debate other topics).
Blackmail typically attacks you in real life, i.e. you can’t limit the scope of impact. If losing an online account on a website X would be the worst possible outcome of one’s behavior at the website X, life would be easy. (You would only need to keep your accounts on different websites separated from each other.) It was already mentioned somewhere in this debate that blackmail often uses the difference between norms in different communities, i.e. that your local-norm-following behavior in one context can be local-norm-breaking in another context. This is quite unlike LW karma.
I’d say thoughts aren’t incentivized enough on the margin, but:
1. A major bottleneck is how fine-tuned and useful the incentives are. (i.e. I’d want to make LW karma more closely track “reward good epistemic processes” before I made the signal stronger. I think it currently tracks that well enough that I prefer it over no-karma).
2. It’s important that people can still have private thoughts separate from the LW karma system. LW is where you come when you have thoughts that seem good enough to either contribute to the commons, or to get feedback on so you can improve your thought process… after having had time to mull things over privately without worrying about what anyone will think of you.
(But, I also think, on the margin, people should be much less scared about sharing their private thoughts than they currently are. Many people seem to be scared about sharing unfinished thoughts at all, and my actual model of what is “threatening” says that there’s a much narrower domain where you need to be worried in the current environment)
3. One conscious decision we made was not not display “number of downvotes” on a post (we tried it out privately for admins for awhile). Instead we just included “total number of votes”. Explicitly knowing how much one’s post got downvoted felt much worse than having a vague sense of how good it was overall + a rough sense of how many people *may* have downvoted it. This created a stronger punishment signal than seemed actually appropriate.
Do you think that thoughts are too incentivised or not incentivised enough on the margin, for the purpose of epistemically sound thinking? If they’re too incentivised, have you considered dampening LWs karma system? If they’re not incentivised enough, what makes you believe that legalising blackmail will worsen the epistemic quality of thoughts?
The LW karma obviously has its flaws, per Goodhart’s law. It is used anyway, because the alternative is having other problems, and for the moment this seems like a reasonable trade-off.
The punishment for “heresies” is actually very mild. As long as one posts respected content in general, posting a “heretical” comment every now and then does not ruin their karma. (Compare to people having their lives changed dramatically because of one tweet.) The punishment accumulates mostly for people whose only purpose here is to post “heresies”. Also, LW karma does not prevent anyone from posting “heresies” on a different website. Thus, people can keep positive LW karma even if their main topic is talking how LW is fundamentally wrong as long as they can avoid being annoying (for example by posting hundred LW-critical posts on their personal website, posting a short summary with hyperlinks on LW, and afterwards using LW mostly to debate other topics).
Blackmail typically attacks you in real life, i.e. you can’t limit the scope of impact. If losing an online account on a website X would be the worst possible outcome of one’s behavior at the website X, life would be easy. (You would only need to keep your accounts on different websites separated from each other.) It was already mentioned somewhere in this debate that blackmail often uses the difference between norms in different communities, i.e. that your local-norm-following behavior in one context can be local-norm-breaking in another context. This is quite unlike LW karma.
I’d say thoughts aren’t incentivized enough on the margin, but:
1. A major bottleneck is how fine-tuned and useful the incentives are. (i.e. I’d want to make LW karma more closely track “reward good epistemic processes” before I made the signal stronger. I think it currently tracks that well enough that I prefer it over no-karma).
2. It’s important that people can still have private thoughts separate from the LW karma system. LW is where you come when you have thoughts that seem good enough to either contribute to the commons, or to get feedback on so you can improve your thought process… after having had time to mull things over privately without worrying about what anyone will think of you.
(But, I also think, on the margin, people should be much less scared about sharing their private thoughts than they currently are. Many people seem to be scared about sharing unfinished thoughts at all, and my actual model of what is “threatening” says that there’s a much narrower domain where you need to be worried in the current environment)
3. One conscious decision we made was not not display “number of downvotes” on a post (we tried it out privately for admins for awhile). Instead we just included “total number of votes”. Explicitly knowing how much one’s post got downvoted felt much worse than having a vague sense of how good it was overall + a rough sense of how many people *may* have downvoted it. This created a stronger punishment signal than seemed actually appropriate.