Slashdot Log In
Ex-Britannica Editor Reviews Wikipedia
Posted by
CmdrTaco
on Tue Nov 16, 2004 09:12 AM
from the something-to-think-about dept.
from the something-to-think-about dept.
0-9a-f writes "Robert McHenry, one-time Editor in Chief of Encyclopædia Britannica, offers his thoughts on Wikipedia at Tech Central Station. While many Wikipedia zealots might discount his obvious bias outright, his broad argument is difficult to ignore. A million monkeys might eventually write Shakespeare, but how would they recognise it once they had?"
This discussion has been archived.
No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
Full
Abbreviated
Hidden
Loading... please wait.
Bias?! (Score:4, Insightful)
Wikipedia is the most biased "reference" source out there. The Karl Rove ariticle basically made him out to be a reincarnated Goebbels. The problem of course is any editor with an agenda can ruin an article.
Re:Bias?! (Score:5, Funny)
Yeah, Goebbels was more hands on.
Parent
Re:Bias?! (Score:5, Insightful)
The problem could probably be solved in several ways; one that comes to mind immediately is similar to what software projects do: have a trusted source sign off on the code before it makes it into the final version. Of course, there are problems with this as well: while most software projects are fairly limited in scope, Wikipedia may not have an expert on symbolism in medieval tapestries or early Gnostic sects.
Wikipedia is a great resource for a quick, informal summary of a subject, but it still has a long way to go before it can be a trusted authority like the Encylopaedia Brittanica. While doubtless it will evolve ways of dealing with the problems inherent in making everything world-editable, the road ahead is a long and difficult one.
Parent
MMmonkeys (Score:4, Funny)
So true! Thats like saying a million monkeys might write a great open-source operating system, but how would they recognise it once they had?
ermm.. wait...
Shakesphere WAS a million monkeys (Score:4, Insightful)
On an infinite timeline, Wikipedia is going to beat the snot out of anyone else--in about 200 years, it will have incorporated everything written before the 21st century into itself.
To speed it along on a realistic pace, the only things that can be done are either contributions or, *gasp*, donations specifically earmarked to hire fact-checkers and editors.
Re:Shakesphere WAS a million monkeys (Score:5, Insightful)
Parent
He's got some great points (Score:5, Interesting)
This is perhaps the most compelling point made in the article, to me. Of course, the cynic's read into that statement is that Wikipedia will never get to the truth (see Asymptote [wikipedia.org]). In some ways though, that's really a pretty undeniable truth about the Wikipedia system -- even if it is True today, some jackass can come in and make it Not True tomorrow. Even if it's Not True for only five minutes, if someone looks at it during that time and assumes it to be correct, the wiki has failed in some sense.
Don't get me wrong, I really love Wikipedia, but I think some of the points raised a very much deserving of further discussion -- if you can make a crofty old coot like this guy happy, it's probably going to be a pretty damn good [encylo|wiki]pedia.
How in the hell... (Score:5, Funny)
Now how in the hell am I supposed to trust this definition of Asymptote?
Parent
It not biased to be Educated (Score:4, Insightful)
It isn't "biased" to be educated or to have the experience necessary to provide a thoughtful and determinative analysis.
Indeed, this man's entire lifetime has been dedicated to editing a series of books whose entire modus operendi is to present information factually and to be explicitly aware of their own limitations. An encyclopaedia is by defination a reference work, a limited collection of reliable information that leads you to further study. That is the opposite of "biased", which is to present self-serving conclusions based on a self-serving assemblage of information.
One thing many Western societies lack right now (but, I would offer, America in particular), is widely accepted basis for producing legitimate knowledge. There are serious concerns with the Wikipedia as a source of authoritative information that exacerbate this problem, not address it.
I welcome this man's comments rather than condemn them.
What's all the fuss about? (Score:5, Informative)
When it really matters, Wikipedia is of course not a primary source to go to. But then, neither are ordinary encyclopedias. When it _really_ matters, you go to the original research papers, subject-specific anthologies and conference proceedings. You will likely never see Encyclopedia Britannica referred to as an authority for an FDA application, for example, or for an envrionmental consequence analysis for some proposed industrial development.
What encyclopedias are good for, on the other hand, is to give a quick tour of and route into an area the reader isn't already familiar with. And since any deeper delving into the subject will require referencing a lot of other sources in any case, any smaller biases or omissions in this "portal text" isn't going to matter.
Out of date? (Score:5, Interesting)
The problem is that information becomes dated very fast. Encyclopedias are useless for researching anything technology related, except as a historical snapshot. And with the collapse of the Soviet Union, new countries were springing into existance faster than the maps could be printed. Revolutions happen, presidents change and information that was once 100% correct becomes stale or downright wrong as new things are discovered. (How much more have we learned about Mars in the past year?) Despite the problems, online encyclopedias are still the way to go, and I would value Wikipedia as a reference far more than the beautiful leather bound dead tree editions.
My parents have a 1930's vintage encyclopedia set that they picked up in a garage sale once. It is quite facinating to go through and read a snapshot of what was known and believed to be true at the time.
Re:Out of date? (Score:5, Insightful)
Which would you rather trust? Peer reviewed articles written by verified, accredited experts in the subject matter; or articles where a high-school freshman's edits are as valid as those of a Ph.D. w/20 years experience in the field?
EVENTUALLY the freshman's will be reviewed and accepted/rejected based on merit. What happens during those times where the article is read BEFORE such a process? What if it was reviewed by everyone in that freshman's entire high school? WOW, 2,500 article reviews and no edits! Sorry, I'd still place the 1 review by the Ph.D. with the experience over all 2,501 of the others.
The idea of digital encyclopedias is one that is due, for the reasons you mention. However, I can't envision how to honestly trust the veracity and validity of information in something like Wikipedia.
All opinions are NOT equal, and a system that gives idiots the same level of credence as experts isn't one that can be trusted.
-Charles
Parent
Edited into mediocrity... (Score:5, Insightful)
In other words, a hundred ill-informed opinions are still worse than one well-informed one. And simply having more people contributing to a piece of work does not necessarily make it better.
The author does get it (Score:5, Insightful)
I have read his comments, and as a not insignificant Wikipedia contributor, I have to say they're correct: he gets it. He does not regard Wikipedia as a useless adventure, but he does not trust (have ) that the collaborative process will necessarily produce excellent-quality articles.
I have to say I agree. I admire the idea that quality is a sought-after goal, but such efforts as the Collaboration of the Week succeed only because Wikipedians focus their attentions on a given article closely for a short period of time.
I have seen too many articles that are confusing and disorganized at a meta-level. A simple factual error invites itself to be corrected, and therefore will be corrected, but restructuring a whole article when you know someone may come along and violate your scheme tomorrow is a discouraging thing.
As well, too many articles on controversial subjects end up being a confusing mismash of argument against or for the point in question. This is particularly the case for recent controversial political figures. I'm happy all the information is there, but I will not believe that the collaborative process will naturally produce an article that covers the issue fairly.
I view the Wikipedia as analogous to a probabalistic algorithm in computer science (e.g. a probabalistic primality testing algorithm). Such an algorithm is true most of the time, and can be a hell of a lot faster than the always-true deterministic algorithm.
Those who criticize the algorithm's potential for falseness miss the fact that its nondeterminism gives it great power, but its proponents should never forget that it is not deterministic.
Re:The author does get it (Score:5, Insightful)
1. The author chose an article from the Wikipedia.
2. The author notes an internal inconsistency
3. The author checks through the edits, which are visible to the public.
4. The author now knows that some controversy exists about the dates, and can do further research to resolve it.
Do you see? Unlike a Brittanica article, the author can see who's been editing it. More importantly, he is given a cross reference of the other edits and changes that user has made, and can judge for himself how credible this person is, and whether they have a clear agenda or bias. At the very least, the reader has no false sense of authority.
There's little faith involved here, instead there's a system for judging credibility and an audit trail. These sorts of systems have worked well in academic settings for a very long time, and indeed are a key part of the internal quality control checks for dictionaries and encyclopedias.
His closing comment, that one cannot tell who has used the facilities beforehand, shows that in fact the author does not get it at all. Precisely the contrary, Wikipedia's strength comes from the fact that one can find out not only who has used the facilities before you, but what they did there. He saw this, yet did not understand its value.
A wonderfully constructed argument, based in incomplete facts, is not a compelling argument. One could wish that a Brittanica veteran had taken the time to do a bit more research on his topic before committing it to writing. Deliciously ironic, don't you think? A sense of false authority is the most dangerous thing an encyclopedia can give, and Wikipedia manages to avoid that almost completely. Yet here we have an authoritative figure making a very basic mistake in research.
Parent
Errors in the Encyclopædia Britannica (Score:5, Interesting)
Errors in the Encyclopædia Britannica which have been corrected in Wikipedia [wikimedia.org]
Re:My Favourite (Score:5, Funny)
This reminds me of Bart's discovery that he was drinking "smilk."
Good luck with your encyclypedia.
Parent
Re:My Favourite (Score:5, Insightful)
Parent
Re:My Favourite (Score:5, Interesting)
I've seen it cited on Aljazeera such as here [aljazeera.net].
Parent
Re:My Favourite (Score:5, Funny)
Parent
Re:Evolve, Sir. (Score:5, Insightful)
Parent
Re:Evolve, Sir. (Score:5, Insightful)
Yes, but edit it in which direction? By "... that the reader has no means to resolve", he means that the reader has no way to determine which number is correct -- the article is internally inconsistent, and it doesn't even have the necessary references for a reader to probe further.
Sure, you can make the article self-consistent easily enough; but most readers would have a 50% chance of making the article consistently wrong, which doesn't help anyone.
Parent
Re:Evolve, Sir. (Score:5, Insightful)
Parent
Re:Evolve, Sir. (Score:5, Insightful)
Oh, you mean after going to a known reputable source of information...This isn't meant as flamebait, but doesn't that right there nullify the point of going to Wikipedia as a source?
Parent
Re:Evolve, Sir. (Score:5, Insightful)
You totally miss his point. He checked an article which he knew was likely to have a problem based on his experience with Britannica. And indeed found that Wikipedia had a problem. His point was that the millions (well eventually maybe) of junior high students going to wiki as an authoritative source for their school reports would have no way of knowing the article is wrong. In addition, how many other countless articles, that he doesn't know anything about and hasn't checked, are also wrong.
If Mr. McHenry's problems with wikipedia was just that this one article has an error, you would be correct, however, he is pointing out that the problem is endemic to the literature form, and that without a staff responsible for researching and verifying the accuracy of all of the articles, and held accountable for that accuracy, there is no way that wikipedia should ever be used as an authoritative source for formal research.
Parent
Re:Evolve, Sir. (Score:5, Insightful)
Replace "wikipedia" with "any single source, professionally edited or not".
Everyone makes mistakes. Britannica makes fewer mistakes, but the mistakes they do make last for an entire year (or longer, for people who don't buy the new set every year). Wikipedia makes more mistakes, but they are corrected as soon as they are uncovered.
It's just two different sides of the coin. Considering the cross referencing capabilities you have online compared to a printed encyclopedia, I prefer wikipedia + google.
Who uses an encyclopedia as an authoritative source anyway?
"So, how'd you research your thesis?"
"I looked up 'nanotechnology' in the encyclopedia."
Encyclopedias, printed or online, are meant as primers, or starting points. Not as a source for research.
Parent
Re:Evolve, Sir. (Score:5, Insightful)
I have a ready guide to test music encyclopedias in the same way. Turn to the entry for Frank Zappa. If it says his given name is "Francis Vincent Zappa", throw it away, because it's badly researched...
It's flat out wrong, and it tells you that whoever researched this article didn't even bother to read Zappa's autobiography ("The Real Frank Zappa Book"). He was christened Frank, and always has been called Frank. Here's the preamble to wikipedia's article [wikipedia.org] Here's Britannica's [britannica.com] Wikipedia has many flaws. It may often be wrong on subtle issues, like the one raised by the Britannica editor. His mistake is to assume that the same is not true of his own estimable organ.
Parent
Re:Evolve, Sir. (Score:5, Interesting)
Parent
Re:Evolve, Sir. (Score:5, Insightful)
He meant that the reader has no way to resolve the information presented to him, and he's right.
Parent
Re:Evolve, Sir. (Score:5, Insightful)
That begs the question: Does the Wikipedia exist to provide reference information for visitors
If I need some reliable information about Alexander Hamilton, I hope it's the former.
The author of the article quotes the apparent goals of the Wikipedia - one of which is to be reliable.
Parent
Re:Evolve, Sir. (Score:5, Informative)
His whole point is that the article started off reasonably good and through haphazard editing sounds like a highschool student wrote it.
I use wikipedia as well, but just to get a starting point on a subject I know little about.
Parent
Re:Evolve, Sir. (Score:4, Insightful)
I can RELY on a real work of reference. Wikipedia is useful, I use it all the time, but I don't treat it like an encyclopedia, more a "hitch hiker's guide to the galaxy". A place to start, but not to trust.
Parent
Re:Evolve, Sir. (Score:5, Interesting)
His argument is that the editing process fails to achieve a decent encyclopedia, and the article on Hamilton - which, he claims, has been edited repeatedly and now appears worse off than when it started - is an example of that. And his question is, how do you know when Wikipedia is authoritative? Just telling him to "edit it himself" is missing the point. I don't have the knowledge or time to write my own encyclopedia. At some point, the product has to become useful to the reader, as well as enjoyable for the contributors. Thus, your point that "Wikipedia thinking requires more depth" counts against Wikipedia, not for it.
Maybe there are valid counterarguments to this guy's point of view - I've used Wikipedia and been, subjectively, satisfied with it - but yours is not one.
Parent
Re:Evolve, Sir. (Score:5, Interesting)
To put the Wikipedia method in its simplest terms:
1. Anyone, irrespective of expertise in or even familiarity with the topic, can submit an article and it will be published.
2. Anyone, irrespective of expertise in or even familiarity with the topic, can edit that article, and the modifications will stand until further modified.
Then comes the crucial and entirely faith-based step:
3. Some unspecified quasi-Darwinian process will assure that those writings and editings by contributors of greatest expertise will survive; articles will eventually reach a steady state that corresponds to the highest degree of accuracy.
Points 1 and are essentially correct. Point 3 is the interesting one. One the face of it he is right again - sure contentious articles will go into dispute, but hum-drum articles on little-known issues? A typo or date inaccuracy could remain there for a very long time.
Of course similar errors could exist with a conventional encyclopedia - but I would be interested in refutations of his point 3.
FWIW, I love Wikipedia. It is an amazing resource and deserves to thrive, but if it can e made more robust, while retaining its essential open, collaborative nature, so much the better.
Parent
Re:Evolve, Sir. (Score:5, Insightful)
Parent
Re:Evolve, Sir. (Score:5, Insightful)
What I like about your post is that you acknowledge that there are problems with the way the wikipedia works, and that this does not make it useless. This is important.
People get so attached to their pet projects sometimes that everything becomes all-or-nothing. If someone critically evaluates one aspect of the project, it's treated as an attack on the whole project-- as a statement that "this project should be trashed"-- and the evaluation is dismissed. This reaction is not productive.
I think the Wikipedia is a great thing, but I also think that this reveiwer's concerns are valid. For all of what it does well, the Wikipedia still has some weaknesses, which should either be addressed (i.e. fixed), or else we should all recognize and live with a certain amount of uncertainty of the reliability of the information you get.
Parent
Re:Evolve, Sir. (Score:5, Insightful)
Yes, he's in the encylopedia business, but then the Britannica is well noted for knowing its business. Wikis still have some trouble along that score, they haven't entirely figured out what encyclopedia means.
KFG
Parent
Re:Evolve, Sir. (Score:5, Interesting)
I think that the poster has an undue faith in the philosophy of the Wikipeadea as opposed to its reality. An interesting but fraught analogy would be Marx's ideas about Socialism versus the real-world implementation of them. Such noble purposes ruined by mere human frailty.
McHenry's point is that despite the excellent ideals behind Wikipedia, which would seem self-evidently true to those of us inclined to believe "in faith" the potentiality of community-based-development, the reality is that in the area of research and writing an encyclopedea (as opposed to software) that:
- Many people are essentially lazy. Many might come upon an article that is incomplete or poorly written but for many reasons will not take the time to correct it even if they are qualified to do so.
- Many people are essentially arrogant. Many might come upon an article that is incomplete or poorly written and will take the time to correct it even if they are notqualified to do so either in subject knowledge or language use.
- Many people are essentially stupid. Many might come upon an article that is incomplete or poorly written and not know the difference.
- Some people (especially adolecents) are cruel and destructive and will muck up perfectly good articles just because they can.
Thus, the maintainers (bureaucrats?) are at a bit of a disadvantage as they have a constantly moving target.A modest proposal then. Why not have a "perfect" flag for articles? This flag would indicate that in the opinion of a certain number of maintainers (or heaven forbit, subject matter experts) the article in question is a close to perfect as possible. The article would then be locked for editing and it would require a special appeal to the bureaucrats to reopen it to change it; for the addition of newly brought to light information, for example.
In this way the bureaucrats can concentrate on the areas that need continuing work without having to continuously go over settled articles. But the community can still bubble up new information and content for existing articles, but in a more controlled manner. Just a thought. I'm certain I'm not the first to bring it up as it seems perfectly obvious.
Oh, and lastly the poster needs to get over the whole "the Internet will save us/print people are dinos who don't get it" attitude. McHenry made a living managing the process of updating an encyclopedia. Just because he did it in a for-profit environment in a medium where cost made revisions an annual event, does not mean he doesn't have insight into the area of maintaining an open encyclopedia in digital form. Don't kill the messenger.
Parent
Re:Evolve, Sir. -- parent NOT INSIGHTFUL (Score:5, Insightful)
In brief, at the end of the day after 100+ edits, the Alexander Hamilton piece is NOT a rich tapestry of nuance and expertise. It's a high-school quality wallpaper job.
The author has proposed mechanism as to why such articles are, in effect, wallpaper jobs and does, in my opinion, a good bit to evidence the "emperor has no clothes" nature of those such as yourself who have a faith-based view of collaboration - the well meaning, but certainly not proven and possibly quite wrong idea that groups of humans "quasi Darwinially" converge upon optimal solutions.
The probem may not be that the author doesn't understand the spirit of Wiki - it may be that he understands it too well.
/ full disclosure: I have contributed articles to Wiki, though I am under no illusions as to its potential and, frankly, share the author's views. When I do serious work, I don't use Wiki as a reference.
Parent
Re:He doesn't get it (Score:5, Insightful)
But the problem is that more often than not the monkey's opinion of the truth or fact isn't in fact necessarily congruent with the truth or fact.
Popular isn't necessarily correct or incorrect. It's just popular. You can have a dozen wikipedians arguing back and forth on a topic but at the end of the day the socratic or arugmentative process doesn't guarantee a solid article.
Parent
Re:He doesn't get it (Score:5, Insightful)
Your sole standard is whether you "like" what's written?! It appears that truth no longer matters in your bottom-up society.
Parent
Re:He doesn't get it (Score:5, Insightful)
To address your point, you're saying that tyranny of mediocrity is acceptable and in fact desireable? In your world, there is no reason for people to aspire to higher knowledge and enlightenment?
Parent
Re:What one's looking for... (Score:5, Interesting)
Is it possible for me to date my wikipedia references in the same way? Particularly when the articles *are* likely to change often, and the review process before publication ('changes are visible immediately' comes up when I have a go at editing) is just not there.
For finding out about stuff wikipedia is fine - but I would prefer to quote something which has been published and can be got at 10 years later for review.
Parent
Re:What one's looking for... (Score:5, Informative)
From an academic point of view I can quote say Encyclopadia Brittanica article on the charango from the 1995 edition.
You can do such things with Wikipedia as well: http://en.wikipedia.org/w/wiki.phtml?title=Slashdo t&oldid=279882
Parent
Re:Credibility (Score:5, Insightful)
However, the process of learning should be a continuous one. There's not much point in treating Wikipedia, or any encyclopoedia, as the final word in knowledge. One could refer someone to Wikipedia and say to them that they could take that as a starting point, then branch outwards and find out more about it.
Being able to take multiple sources, evaluate them all, then form your own opinions is more valuable than just reading something in one place once. That's only my opinion though, and it is always horses for courses.
Parent
Re:Shakepsearmonkey.pl (Score:4, Funny)
Hmmm... We can rephrase that, can't we?
For each Slashdot headline there are another million monkeys reading and discussing the article.
Parent
Re:Give me a break! (Score:4, Insightful)
And as far as inaccurate information goes, I have a two word response for that: political blogs. Many people are perfectly happy to get their Important Information a blog by somebody who can't name their sources and who has no responsibility to be accurate. The modern measure of accuracy is simply a matter of how many people believe and repeat a statement.
Err... you confuse accuracy and popularity.
The modern measure of perceived accuracy may be that, but that doesn't make it right.
If enough people believe that the world is flat, that won't make it so. Even if lots and lots of blogs talk about it.
-Rob
Parent
Re:Took the time... (Score:4, Insightful)
Parent
Re:One might also say... (Score:5, Insightful)
Unfortunately, an encyclopedia's failure mechanism is much more insidious and hard to detect.
Parent
Re:so, what did he say? (Score:5, Informative)
If we replace the word "community" with the word "committee" the problem is obvious.
Parent