Tracking excessive downvoting seems like something that can be pretty well automated.
Or, if the rule for how much you are allowed to downvote (something like 1:4 on karma?) isn’t the right rule, change it to something else explicit.
Or, if the rule for how much you are allowed to downvote (something like 1:4 on karma?) isn’t the right rule, change it to something else explicit.