Slashdot Log In
A Wikipedia WIthout Graffiti
from the dog-without-a-bone dept.
Editor control over articles is controversial within the "radical collaboration" community; the Wikimedia foundation lists five "foundation issues that are essentially beyond debate", which includes "Ability of anyone to edit articles without registering". (In practice there are some safeguards in place to protect articles that are frequent targets of vandalism, like the George W. Bush entry.) But I'm fanatically results-oriented in my thinking, and I always ask: What are the purposes of this project, and how does this feature help achieve those purposes? It seems to me that a free online encyclopedia fills four main needs:
- A source of information about pop culture that can be fun to read even without being 100% sure that it's accurate (like who R.A.B. is)
- A source of information that can be freely and legally redistributed, e.g. by printing out copies for a class to read
- A source of information on subjects where you need to be close to 100% certain that the information is reliable -- at least as certain, say, as you would be if you read the same fact in several books
- A source of information that you can cite in a school paper as being reasonably authoritative and reliable
For the reliability problem, I can't improve on this priceless sentence from Wikipedia's own "Citing Wikipedia" page:
Wikipedia has actually done much better than I would have expected -- a study done in 2005 found that Wikipedia averaged about 4 errors per article compared to Britannica's 3, which is pretty good for a site where anybody can write that Columbus sailed to the New World in ships named the Ninja, the Pinto, and the Santa Fe. But for a site that harnesses the efforts of volunteers all over the world, I think the goal should be to surpass what has been done before, not just to tie with Britannica. And even if Wikipedia's error rate someday beats Britannica's, under its current model Wikipedia can never have the key property that Britannica has, which is that you can cite it as an authoritative source without sounding silly.For many purposes, but particularly in academia, Wikipedia may not be considered an acceptable source. [ citation needed ]
Citizendium's model of editor-approved articles, and editor approval of further edits to those articles, can help to achieve the benefits of collaboration, harnessing the efforts of volunteers, without falling into Wikipedia's traps. Assuming you can verify an editor's credentials (and we'll get to this in a minute), having an editor manage an article means two things: (a) you know the page wasn't vandalized in the last five minutes, and (b) you ought to be able to cite the work as a reference in a paper if your teacher isn't a total Luddite and you can explain to them how Citizendium works. Meanwhile, volunteers can still contribute without their own credentials being checked out; they can write as much as they want for an editor-approved article, as long as it's approved by the editor before going live.
There are still loopholes, of course. Currently Citizendium asks people to edit under their real name, but says that "we will use the honor principle to begin with", so anyone could claim to be a professor or a lunar astronaut. But the key words are "to begin with"; the difference between Wikipedia and Citizendium is that Citizendium views this as a loophole and not an intrinsic "community value", and loopholes can be fixed. To make the reliability as airtight as possible, I hope that Citizendium will eventually implement some sort of verification system, such as checking a professor's contact information on a Web page in the "faculty" section of an .edu Web server. I'm not instinctively thrilled by the thought of checking out volunteers' contact information, but it seems like the only way to achieve goals #3 and #4 above, so if it's as simple as sending a verification e-mail to an .edu address, that's a lot of gain for little effort. (Remember, this only has to be done for editors who sign off on articles, not for all volunteers. A non-editor volunteer could still ask to have their credentials checked out, so that they can be cited by their real name in the "end credits" of an article that lists volunteer contributors. But impersonation among regular volunteers is not likely to be a problem, since the editorial approval process ensures that only value-adding edits will be allowed, and it's unlikely that Alice would pretend to be Bob so that Bob can take all the glory of Alice's contributions to the project!)
Besides verifying authors' credentials, the one change that I hope Citizendium considers in the future is to give authors and editors credit at the top of each article -- or, for articles with many contributors, perhaps editors would be listed at the top and the "end credits" would list all contributors, on a separate page if necessary. This is because credited authorship for an article can help improve the article's usefulness in two ways -- the article can be cited as a reliable source, and the "name up in lights" factor rewards people for contributing more and better articles. Having authors listed only on the history page of an article, as they are in the current model, achieves the credibility benefit but not the "name up in lights" benefit. Larry Sanger suggested that having authors listed at the top of each article might put off readers from submitting edits -- if an article is perceived as being "owned", then others might feel like it's rude for them to change it. For me personally, this could go either way -- on the one hand, I might not realize that I was welcome to edit an article, but on the other hand, I think I might be more inclined to submit edits if I knew there was an editor in charge to keep someone else from frivolously overwriting my edits later. But in any case, to address this problem, each article could carry a banner at the top saying "Readers are encouraged to submit edits and other suggestions", and each paragraph could be accompanied by an "Edit" link, similar to Wikipedia (except that edits would go into a queue to be reviewed by the editor instead of going live). This would address the ownership-intimidation problem without taking away from the "name up in lights" factor. Sanger says that the Digital Universe Encyclopedia -- comprising the Encyclopedia of Earth and an Encyclopedia of the Cosmos, under development -- has plans to join with Citizendium and will use the credited-author model on their version of the site.
You might say that editors having their "name up in lights" would be an ego thing for editors, and I think you'd be right -- but I don't think this would be a bad thing, inasmuch as ego would motivate more people to become editors and do their best work. Perhaps I'd be wrong about this. Maybe a limited experiment could be carried out with two sites that are similar in every respect except that one allows editors and authors to take credit for their work, as might turn out to be the case with Citizendium and Encyclopedia of Earth. The point is that I don't think such a suggestion should be judged by whether it goes against the "spirit" of the project (as it certainly does in the case of Wikipedia!), but rather whether it helps to achieve the projects goals, such as goals #1 through #4 listed above.
There are still some problems that Citizendium's differences from Wikipedia won't solve. Many schools discourage citing Wikipedia not because it's written anonymously or because it contains errors, but because it's an encyclopedia. Yale's guidelines for citing Wikipedia state:
Presumably many academics would have the same objections to a student citing Citizendium. I understand what these teachers mean, but I think this is a case of not thinking in terms of results. If the purpose of an assignment is to collect and present information, then any means of accomplishing that goal should be valid, including the easiest method of looking up the information in an encyclopedia. To make a student look beyond the encyclopedia, an assignment can simply require depth of research that goes beyond what the encyclopedia would provide. (Students, if you're worried that your teacher will take this to heart and make your assignments harder, just be happy that your teacher is hip enough to be reading this in the first place.) Some things are hard, but they should only be hard if they're intrinsically hard, not because you handicapped yourself with arbitrary rules.As an encyclopedia, Wikipedia is written for a common readership. But students in Yale courses are already consulting primary materials and learning from experts in the discipline. In this context, to rely on Wikipedia -- even when the material is accurate -- is to position your work as inexpert and immature.
But there is another, more permanent problem -- even with verification of authors' credentials, how do we know that the information in Citizendium articles is accurate? How do we know the author didn't make a mistake, or lie? This gets into deeper issues because these problems exist no matter what source you're consulting. There are books in print that deny the Holocaust or the possibility of evolution, and they're printed on real paper, with ISBN numbers and everything. Some of them even make it into libraries. How skeptical should we be of we read in books? In January two advocacy groups presented a report to Congress in which many government scientists said they felt pressured by the Bush administration to downplay the global warming threat in their statements. Does that mean statements from government scientists are inherently suspect?
And almost anyone who has had more than two articles written about them, knows the feeling of reading the article and reacting, "Wow, I had no idea that I was a transgendered NRA member who volunteers with the Moonies!" The New York Times is hosting an article about me from 2000 claiming that I was fired from Microsoft, when I actually quit. I showed them a copy of my personnel file with "Voluntary resignation" printed on it, but they have still refused to change the article. (When I first wrote to the paper's "Public Editor" about the matter, created to restore "reader credibility" after the Jayson Blair scandal, they replied that they wouldn't change the error because it never appeared in the print version of the paper. Huh?) I put up my own webpage to tell my side of the story, but if you were a Wikipedia or Citizendium editor and you had conflicting information from different sources, who would you believe, the New York Times, or a Web site called PublicEditorMyAss.com?
And yet, I freely admit that even today, I would trust a fact from the New York Times more than a fact from Bob's Bait And Tackle Shop And Technology Blog. We instinctively trust sources because of their reputation; we figure that they must have gotten their reputation somehow. This is not a great algorithm for deciding trustworthiness, but it may be the best that we can do -- in a world where we can't verify every fact firsthand, what choice do we have but to rely on sources that have provided mostly-reliable information in the past? (Wikipedia vandals are able to hack this mental algorithm because we think of Wikipedia as "one source" with a high average reliability, when it's really comprised of many sources, some of whom are deliberately less reliable than others.)
So, I think the Citizendium model is a move in the right direction -- taking into account the limits of what we can know from third-party sources, and doing the best we can within those limits. The least we can do is to know who has signed off on the accuracy of an article, so we can factor that into our decision to trust it. Last month Citizendium released their first editor-approved article, a single article about Biology. It may not look like anything revolutionary right now, but the difference between that and the Wikipedia entry is that you can't change the title of the Citizendium article to LARRY SANGER IS A BUTT BRAIN HA HA. You have to go through an editor for that.
Wikipedia's problem is also it's biggest advantage (Score:5, Insightful)
I certainly hope that editor doesn't have a bias (Score:4, Insightful)
But that's a nit- it's a fundamental problem of ANY reference (be it the news, university research, or even good old Britannica).
Join Up! Fight vandalism on wikipedia (Score:5, Interesting)
Watch a livefeed of edits in real time.
Click on suspicious ones to check them out, and revert when apropriate. It's easy, fun and satisifying.
Re:Join Up! Fight vandalism on wikipedia (Score:4, Insightful)
Citing an encyclopedia (Score:5, Insightful)
Wikipedia can do the same... (Score:5, Insightful)
Besides, who wants to reproduce all the wikipedia knowledge into a new database? Let's just improve the one we have already. (Yes, the new database can just copy wikipedia's content, but they then have to credit wikipedia indefinitely.)
At least Slashdot posts aren't peer editable (Score:5, Funny)
Wait a second! (Score:5, Funny)
Quick, mod article away!!
Re:Wait a second! (Score:5, Funny)
I'm not registering or logging in. (Score:4, Insightful)
I can't even be bothered to read into the docs to find out whether they're going to try and make money on this somehow. Well written Slashvertisement, but Wikipedia is obviously a very good source or not so many would use it. Semi-anonymous editors seem to be hammering out the graffiti pretty well regardless.
Re:I'm not registering or logging in. (Score:5, Insightful)
Mike Johnson
Citizendium Executive Committee
Re:I'm not registering or logging in. (Score:5, Interesting)
Zach Pruckowski
Citizendium Executive Board
Vaporware & longevity (Score:4, Insightful)
Consider the story of the Phantom console [wikipedia.org]. Slashdot collectively said "Interesting, but let's see some proof". The more flowery or adrenaline pumped the prose, the more skeptical we should be when there's nothing we can actually get our hands on. This article about the greatness of Citizendium falls into the same trap, and our response here should be to hold off on our praise until there's something that can be evaluated.
One other thing is the issue of graffiti. It's given quite a bit of exposure, heck, it's even in the title of the article itself. But realistically speaking, how big of a problem is it? Wikipedia has a pretty darn good response time when it comes to defacement/graffiti. There are vandalbots that autorevert some changes that meet certain heuristics, there are groups of people who skim through the latest changes, there are IRC channels that make it easy for people to see a feed of what's happening... I'd like to suggest that vandalism isn't really a _problem_ in the sense that it hurts the project, because even though there's lots of vandalism, it's nipped in the bud so quickly that 99.9% of the end users who are just _using_ the project don't see it. I think there are people who perceive vandalism as a bigger issue that it is because they either take the knowledge that vandalism is possible and logically extrapolate that it must therefor be widespread, and the other group are the folks who specifically fight vandalism, and because of that, it's the only thing they see on the project.
Citizendium is a neat idea, but I hope that as a community we'll let it succeed or fail on its own merits and not because we want to "teach wikipedia a lesson" or because the PR behind that project is controlling our feelings.
Replacing Wikipedia (Score:5, Insightful)
That said, Mr. Haselton's article smells an awful lot like astroturfing.
Compromise? (Score:5, Interesting)
Registered users could have a merit number based on how long they've been around, how many edits they made etc.
Also, registered users could mod authors as well as articles (and, hence, their authors.) That would give each author a semi-reliable merit value. Then you could calculate a merit figure for an article from how much was contributed by whom and any mod points for the article itself.
An example of Wikipedia's problem (Score:5, Interesting)
"One regular on the site is a user known as Essjay, who holds a Ph.D. in theology and a degree in canon law and has written or contributed to sixteen thousand entries. A tenured professor of religion at a private university, Essjay made his first edit in February, 2005.... Essjay is serving a second term as chair of the mediation committee. He is also an admin, a bureaucrat, and a checkuser, which means that he is one of fourteen Wikipedians authorized to trace I.P. addresses in cases of suspected abuse. He often takes his laptop to class, so that he can be available to Wikipedians while giving a quiz, and he keeps an eye on twenty I.R.C. chat channels, where users often trade gossip about abuses they have witnessed."
The information in The New Yorker came from his user page that he developed over the previous year. He pushed all the correct Wikipedia buttons: he said he was gay, an expert on Catholocism but an elder in a liberal Protestant church, he and his partner had both a cat and a dog, and he was past 30 but not yet 40. From credentials like this, and from his mind-boggling level of activity on Wikipedia, he became administrator, bureaucrat, checkuser, oversight, and last month was named a community manager at Wikia.
Perhaps because he is employed by Wikia now, Essjay has coughed up his real name. He doesn't have two PhDs, and he isn't a tenured professor. He's a 24-year-old living near Louisville, Kentucky. The New Yorker, famous for its fact-checking, got it all wrong.
Incidents like this illustrate the limitations of the Wikipedia approach. It's not an encyclopedia, but rather it's a video game that escaped from its box, and is now influencing real people in the real world.
Re:An example of Wikipedia's problem (Score:5, Insightful)
Wikipedia: Mirror for the beliefs of the masses. (Score:4, Insightful)
Paraphrase. I don't know who said it first, and perhaps a little better than I remember it. But the point is that Wikipedia has an IQ of 100. To claim that blatant mistakes in Wikipedia will eventually be corrected is, I think, statistically unlikely.
Where Wikipdia is especially good is in straight factual information with no need for "interpretation." For example, where is Barcelona, Spain? It gives you latitude and longitude; you can check it with Google Earth and correct if necessary. Sometimes Wikipedia will give a coordinate in the middle of the ocean, It's not always accurate, but it is easily verifiable. It's also good where it has 'incorporated' text from other sources. For example, much of the historical information on Roman civilization is from the 1911 Encyclopedia Britannica, still considered one of the best efforts ever produced. It is in the public domain. Wikipedia copied it. An interesting point when 'studies' show Wikipedia's error rate better or worse than Britannica.
Where Wikipedia is especially poor and unreliable is in political issues and debates. Tenacity and anger count far more than accuracy. Extremists tend to win these battles because they are so adamant and, for them, so much is at stake for them to ensure Wikipedia "gets it right." Antagonists accuse their opposite of "changing history," because, of course, God's on their side. Anyone who uses Wikipedia to learn accurate information on political issues is, as Cowboy Neal says of using Slashdot polls, insane.
Irony alert! (Score:5, Funny)
Linking to a satirical, fake news article in theonion.com as evidence of the unreliability of citing Wikipedia as a source; I applaud your brazen audacity sir.
Re:Who watches.... (Score:4, Funny)
I know, I know, "and who watches the watchmen watchmen?" Watchmen watchmen watchmen watch watchmen watchmen.
Re:Who watches.... (Score:4, Informative)
Re:Wall o' text (Score:4, Insightful)
Re:Wall o' text (Score:5, Informative)
1) The Citizendium introduces the concept of personal responsibility. People are asked to use their real identities so that reputations are on the line (as they should be, because reputations are also on the line when siting sources).
2) The Citizendium will demand in its editors the same qualifications that would qualify that person as an expert outside the encyclopedia. This is a crucial variation of the Wikipedia "editor system" that you linked to. It will require a great deal of work on behalf of its administrators, but will make the Citizendium respected by professionals.
Re:Wall o' text (Score:5, Insightful)
I'm not sure what the solution to this is. But I worry about this sort of thing in an "editor" system. Perhaps on articles that aren't deemed "controversial", you can have a single editor, but on articles that are deemed controversial (as judged by moderators who haven't been involved in the article), you need multiple editors, and only content that they can reach consensus on can be published. Do you think this would work?
Re:Yet again the repeated canard about Britannica (Score:4, Funny)
Defending Wikipedia is the most direct way to show that you are an idiot. Simply using Wikipedia, as a reader or an editor, for more than five days demonstrates how worthless it is as a resource, and particularly as a replacement for a real encyclopedia.
A real encyclopedia rests on authority, that is its sole reason for existance. If you can't afford the time to to go primary sources and can't afford the time or the money to get a library full of secondary ones, you use an encyclopedia based on whether you can trust the people who write and edit it to give a reasonable (and I do mean "reasonable", not NPOV or any of that shit) overview of any subject the rest of your library is weak on. A real encyclopedia addresses this in the most direct way possible: it tells you who wrote it, who edited it and what their qualifications are. Wikipedia does not.
There is no authority in any wikipedia page. Some have plausibility, but that's it. And they may not even have that tomorrow. And if you are well enough versed in a subject to know what is plausible but wrong and what seems implausible but is nevertheless right, then why are you even reading the entry? To fix it? Why bother? The same idiot that messed it up in the first place may well be back in an hour to revert your changes. Are you going to waste the rest of your life policing an ever-changing page of folk-wisdom?