last updated 9.9.99 by CmdrTaco
This document will attempt to explain the moderation system that lies underneath Slashdot's vast comment section. It will try to explain some of the history of the system, as well as how it works (or doesn't work) from both the perspective of the user, and the moderator. It is always in flux.
As you might have noticed, Slashdot gets a lot of comments. Thousands a day. Tens of thousands a month. At any given time, the database holds 40,000+ comments. A single story might have a thousand replies- and lets be realistic: Not all of the comments are that great. In fact, some are down right terrible-- but others are truly gems.
The moderation system is designed to sort the gems and the crap from the steady stream of information that flows through the pipe. And wherever possible, it tries to make the readers of the site take on the responsibility.
The goal is that each reader will be able to read Slashdot at a level that they find appropriate. The impatient can read nothing at all but the original stories. Some will only want to read the highest rated of comments, some will want to eliminate anonymous posts, and others will want to read every last drip of data, from the First Posts! to the spam. The system we've created here will make that happen. Or at least, it sure will try...
In order to understand the system, it might help to understand how we got there. It wasn't random, it was trial and error and progression. I'm constantly tweaking and changing, trying to squeeze more out. Trying to make a more efficient, more fair system.
In the beginning Slashdot was small. We got dozens of posts each day, and it was good. The signal was high, the noise was low. Moderation was unnecessary because we were nobody. It was a different world then. Each day we grew, adding more and more users, and increasing the number of comments submitted. As this happened, many users discovered new and annoying ways to abuse the system. The authors had but one option: Delete annoying comments. But as the system grew, we knew that we would never be able to keep up. We were outnumbered.
Hand Picked Few
So I picked people to help. Just a few. 25 or so at the end. They were given the simple ability to add or subtract points to comments. The primary function of these brave souls was to weed out spam and First Post and flamebait. Plus, when they found smart stuff, to bring it out.
The system worked pretty well, but as Slashdot continued to grow, it was obvious that these 25 people wouldn't be enough to keep up with the thousands of posts we were getting each day. It was obvious that we needed more.
400 Lucky Winners
So we picked more the only way we could. Using the actions of the original 25 moderators, we picked 400 more. We picked the 400 people who had posted good comments. Comments that had been flagged as the cream of Slashdot. Immediately several dozen of these new moderators had their access revoked for being abusive, but they settled down.
At this time I began to experiment with ways of restricting the power of moderators to prevent abuses. 25 people are easy to keep an eye on, but 400 is another matter. I knew that someday I would have even less control since I intended to eventually give access to even more people. While fundamentally moderators still added and subtracted points, the number of points they were given dropped from hundreds to dozens.
As time went on, I began working on the next phase: mass moderation. I learned a lot from having so many moderators. I learned that I needed to limit the power of each person to prevent a single rogue from spoiling it for everyone. And Then we took the next step:
Today: Most Anyone
Today any regular Slashdot reader is probably eligible to become a moderator. A variety of factors weigh into it, but if you are logged in when you browse Slashdot comments, you might occasionally be granted moderator access. Don't worry about it- Just keep reading this document and learn what to do about it!
It's probably the most difficult part of the process: Who is allowed to moderate. On one hand, many people say "Everyone", but I've chosen to avoid that path because the potential for abuse is so great. Instead, I've set up a few simple rules for determining who is eligible to moderate.
So the end result is a pool of eligible users that represent (hopefully) average, positive slashdot contributors. Occasionally (well, every 30 minutes actually) the system checks the number of comments that have been posted, and gives a proportionate amount of eligible users "Tokens". When any user acquires a certain number of tokens, they become a moderator. This means that you'll need to be eligible for many of these slices in order to actually gain access. It all works to make sure that everyone takes turns, and nobody can abuse the system, and that only "regular" readers become moderators (as opposed to some random newbie ;)
When a moderator is given access, they are given a number of points of influence to play with. Each comment they moderate deducts a point. When they run out of points, they are done serving until next time it is their turn.
Moderation takes place by selecting an adjective from a drop down list that appears next to comments. Descriptive words like 'Flamebait' or 'Informative'. Bad words will reduce the comments score by a single point, good words increase a comments score by a single point. All comments are scored on an absolute scale from -1 to 5. Logged in users start at 1 (although this can vary from 0 to 2 based on their overall contribution to discussions) and anonymous users start at 0.
Moderators can not participate in the same discussion as both a moderator and a poster. This is to prevent abuses, and while it is one of the more controversial aspects of the system, I'm sticking to it. There are enough lurkers that moderate, that if you want to post, feel free.
Moderation points expire after 3 days if they are left unused. You then go back into the pool and might someday be given access again.
Concentrate more on promoting than on demoting. The real goal here is to find the juicy good stuff and let others read it. Do not promote personal agendas. Do not let your opinions factor in. Try to be impartial about this. Simply disagreeing with a comment is not a valid reason to mark it down. Likewise, agreeing with a comment is not a valid reason to mark it up. The goal here is to share ideas. To sift through the haystack and find needles. And to keep the children who like to spam Slashdot in check.
I just got moderator access, what do I do?
The fact that you are reading this document proves that you are already on the right track.
Why can't I suddenly moderate any more?
I found a comment that was unfairly moderated!
Lemme know and I'll look at it. Sometimes I might agree and revoke access to a moderator. Usually I disagree and let it go. Its difficult to be the judge on this stuff since it is so subjective.
Is this censorship?
We're not technically deleting anything. In fact "We" technically aren't really doing much at all. The masses are doing this for themselves (in theory anyway). And you are always given the option of clicking the threshold control over to '-1' and reading everything uncut, so I really have a hard time saying this truly is censorship. But if you really want to call it that, I can't really argue. We're trying to make as many people happy as possible here- if you don't like something, you can probably change it in the user preferences to more suit your tastes anyway.
What is a Good Comment? A Bad Comment?
What is Karma?
Karma is an internal value Slashdot uses to determine things like initial posting score, and moderation eligibility. To you, karma is a label like "Good" or "Bad". Many things on Slashdot affect karma, including moderation done to your comments, accepted story submissions, and meta moderating.
3 Days Is Not Long Enough To Moderate!
On the contrary, I think it's too long, although maybe I should change it to like "24 hours after you first are informed that you have moderator access". My reasoning is pretty simple: I don't want people to stockpile their points. I want people to use them or lose them. Otherwise people will hold on to their X points until a story comes on that they have a strong opinion in, and they will be tempted to moderate the discussion so as to sway things "their way". By expiring points quickly, moderators are encouraged to use them. Sometimes their points might expire unused, but thats ok: the system will just give points to someone else.
Why Don't I get my points back after I post in a discussion I moderated?
Basically because of the following scenario:
This scenario would easily allow a user to continue to have moderator access for as long as they felt like it. Simply disallowing the retrieval of points makes this impossible.
Ideas for the Future
This is a system in development. It may never be done, but here are some of the ideas I'm currently mulling over for incorporation into a future version of the moderation system. They might not happen. Hell, I'm lazy, I'd prefer it if they didn't have to! But if I decide that they are for the best, I'll implement them somehow.
How can I improve my Karma?
What follows was originally a story submission by dkh2. It seemed to me that it would better serve readers here: 10 tips for improving your Karma:
Post intelligently:Interesting, insightful, thought provoking comments are rated higher on a fairly consistent basis.
Post calmly:Nobody likes a flame war. In fact, more times than not the flamer gets burned much more than their target. "Flaim Bait" is hit quickly and consistently with "-1" by moderators. As the bumper sticker says... "Don't be a dick."
Post early:If an article has over a certain number of posts on it already yours is less likely to be moderated. This is, less likely both statistically (there are more to choose from) and due to positioning (as a moderator I have to actually find your post waaay at the end of a long list.)
Post often:If you only post once a month you can expect your karma to remain low. Also, lively discussion in an open forum is what makes Slashdot really "Rock the Casbah."
Stay on topic:Off topic posts are slapped quickly and consistently with "-1" by moderators.
Be original:Avoid being redundant and just repeating what has already been said. (Did I really just say that?) Yes, being moderated as "redundant" is worth "-1" to your post and your karma. Especially to be avoided are the "what he said" and "me too" posts.
Read it before you post:Does it say what you really want it to say? Check your own spelling and grammar. Occasionally, a perfectly beneficial post is passed over by moderators because of this completely irrelevant to content feature. This is also a good approach to checking yourself for what you're really saying. Can't tell you the number of times I've stopped myself from saying the opposite of what I meant by checking my own s&g.
Log in as a registered user:I know, this sounds obvious but, "Anonymous Coward" does not have a karma rating. You can't reap the perceived benefits of your own accidental brilliance if you post anonymously. Have pride in your work and take credit for it.
Read Slashdot regularly:You can't possibly contribute to the discussion if you're not in the room. Come to the party and play.