“Decision algorithm” was here my metaphor for humans. Like a rulebook for human censors, who themselves are smart and educated, although not extremely.
In a hypothetical situation where a government would officially appoint censors, or if the social networks would decide to optimize for something other than low costs. In a hypothetical situation, where this would be relatively high-status job… I mean, you’d have the power to shape the public discourse, and that is no small thing; give it a decent salary and many university-educated people would compete for it. But you wouldn’t hire the smartest ones, because they have a better use of their skills; you wouldn’t want to hire people with contrarian ideas; and to censor the overwhelming amounts of text online, you would need to hire lot of people, so you couldn’t afford to be too picky even if your budget was unlimited.
The average censor, if such job existed today, would realistically be some bored bureaucrat, who doesn’t give a fuck about ideas, and just applies rules mechanically, trying to cover his ass. But an idealized censor would be a smart and educated person, passionately opposing pseudoscience… kinda like I imagine the people who write on RationalWiki, except maybe less politically mindkilled. And with a button that would allow them to delete content anywhere online. And I wondered what would happen as a consequence.