Bloggers or High Schoolers, Where is the Literary Talent? 284
word munger writes "A few weeks ago, Chad Orzel read a New York Times article which analyzed the best high school writing on the new SAT test. The Times' writer appeared surprised that the best high school writing was so bad. Chad then wondered if the best bloggers could do any better under the same conditions and it was put to the test. Over 500 people tried the timed online test, but just 109 scoreable responses resulted. Professionals graded all the responses which were then posted on a web site where readers can rate the essays themselves, as well as find out the professional score. So who's a better writer, a blogger or a high schooler? You can also read Chad's analysis — or better yet, you can decide for yourself."
SAT essay too fast (Score:5, Insightful)
Who cares? (Score:2, Insightful)
Come on. Good writing isn't produced like this, and it's not reasonable for the population of a single SAT trial to produce good writing. # of SAT writers infinite monkeys, and SAT examination time infinite. So big deal.
Ever read a raw manuscript? (Score:5, Insightful)
There seems to be a belief that the first draft of anything should be perfect.
You have an essay to write on a test? no problem, it should look like the finely crafted masterpiece someone else wrote over a period of days, months, or even years. And you have 10 minutes to do it.
People should be introduced to the first draft manuscript of any literature, I think they would be surprised at how awful much of it is.
Re:blogs are not eassays (Score:2, Insightful)
And what the crap are "paraphers"?
bein' articulate gets "u" nowhere (Score:3, Insightful)
If someone writes a long winded treatise on a topic, most people will ignore, and even be annoyed by it. Even worse, they will go for an easy to understand, though inaccurate, criticism of it
So yeah, if you want to be popular
Training For The Test (Score:5, Insightful)
You get to rank kids, but you also get kids that have trained for the test. I have two sisters that are teachers that quite specifically teach to the test-du-jour. I mean not just a couple of weeks, but every single day's learning plan is oriented around the test the kids take that year.
So, we've got kids being trained for a test, which is certainly not an "education." Or maybe that's what passes for an education for the unwashed, shrinking middle-class masses in America?
Absolutely Unsurprising (Score:5, Insightful)
1) The SAT writing section gives a student only the opportunity to write a first draft.
2) The SAT writing section is almost always on an incredibly boring and uninspired topic, because the subject of the essay must be as equally accessible to all test-takers as possible. It's also quite obvious that it is hard to write well on a subject you could not care less about. The intersection of good writers and those interested in the topic has to be miniscule, if nonexistant.
3) The SAT writing section is graded based on grammatical correctness and the logical ordering of ideas. It takes no account of whether those ideas make canonical sense, only that they were ordered in a consistent and logical manner.
The SAT writing section can not gauge anything besides one's ability to write in the style of the MLA.
It's been said a million times, but I'll say it again: The SAT score only measures one's ability to take the SAT.
Disclosure: I am a recent college grad who did very well on the SATs.
misuse of test (Score:5, Insightful)
OTOH, in the real world, we seldom have to develop a formulaic arbitrary piece of writing on a topic that we might not only have no interest in, but no background in. That is a good thing because writing about what you know nothing of, and have no interest in, makes you a hack. Certainly no one going off to college is hoping to be a hack.
A while back an english teacher got a hold of one of my writing and proceeded to 'correct it'. The teacher found several errors on the page, some I didn't realize I made, some that did not change the meaning, some that were bad. Understand I feel like I know who to write, and I feel like I know English. I know to say 'on which side the bread is buttered'. I know that saying 'to boldly go' is wrong, but the correct structure changes the meaning. I understand that as a teacher of English one must be pedantic, but expecting a writer to produce a good product in 25 minutes, on a random subject, is just idiocy. Such a requirement is an insult to the adult process of writing, in which one starts off with an interesting idea, and develops it over time.
Many years ago Byte magazine had a silly essay comparing quality the writings of Hemmingway to the quality of a computer program. Even at the young age I read this, I understood that the analogy was daft, as a computer program must be perfect, and reflects a technical process that changes over time, while a published creative work of fiction is a snapshot of a creative process. The later need not conform to some arbitrary standard of perfection to be a perfectly wonderful tale.
In the end this is one of those studies by one of those people that believes a good SAT score has some bearing on your actual ability to produce a real product, creative, technical, or otherwise. This is not sour grapes. I have always had very respectable standardized test scores, scores in fact that probably overestimate my ability. OTOH my ability to produce has nothing to do with the test scores.
"It takes hard writing to make easy reading." (Score:5, Insightful)
These essays seem to be running about 250 words... about a page.
Jack London was proud of himself for turning out 1000 words every day. George Bernard Shaw set his stint at five pages a day.
And of course a professional writer has been preparing to write those words and thinking about them well in advance. And they are on a topic that the writer has selected him- or herself, and has some knowledge of.
So they hit a _high school student_ cold with a topic the student has never seen before and give him or her twenty-five minutes (how on earth did they come up with that figure? Why not a round half-hour, at least?) to do, unprepared, what takes a professional writer a couple of hours, prepared... and people are surprised at the results?
This isn't a test of writing in any meaningful sense of the word. I don't know what it's testing, but it isn't writing.
With a question like this ... (Score:2, Insightful)
Horrible prompt (Score:5, Insightful)
Do memories hinder or help people in their effort to learn from the past and succeed in the present?
That is an incredibly difficult question that philosophers could spend a lifetime thinking about. In fact, I've found that many philosophers addressing these difficult issues often have glaring logical holes, unfounded assumptions, and most strikingly, atrocious writing.
For some reason, the SAT believes that ambiguous, poorly crafted prompts somehow judge a student's writing abilities. If they want to judge a student's writing skills, this would be a much better prompt:
Your friend is contemplating cheating on the SAT. Write a letter to dissuade him/her from doing so.
At least there are concrete and fairly obvious reasons here, and I wager that you'd very quickly be able to see which students can write well and which can barely craft coherent sentences.
Re:Horrible prompt (Score:5, Insightful)
"Given that people with no memories demonstrably fail to learn anything, including simple things like where they are or what day it is, clearly they help."
If I were taking this test, I could easily expand that into the 5-Paragraph Magic Form I was taught for writing Unreadable Insipid Essays (TM), but why? For that matter I could cut that down by another half and still answer the question with this argument that I find undeniable.
(I could twist and stretch the definition of "memory" and "learning" to make it not true, but across most combination of definitions of memory and learning this argument holds. You'd have to get pretty pedantically biological to make it false.)
Re:this study is a little iffy (Score:3, Insightful)
Also, homework unfairly discriminates against students who choose not to do it...
Re:I don't find this particularly surprising (Score:5, Insightful)
It's easy to say that little Timmy is a math prodigy because he's solving integrals in his head by the time he's in seventh grade. It's very difficult to say that little Billy is a literary prodigy because the degree of assimilation and the quality of work produced are both measured very subjectively. In math and science, there are simple, fairly straightforward ways of measuring how well a student _recalls_ concepts and how well they can _apply_ the concepts. That latter one does require someone to read a bunch of logic on paper, and then estimate how well the kid has applied the concepts they've learned (i.e. does the student seem to understand "force" or is she just plugging and chugging), but that can be objectively determined (did she get the right answer, and do her steps to that answer clear and logical).
In writing, someone has to actually sit down and read everything they student has written, judge it as objectively as they can, and then assign it a number grade. You could give a test on sentence structure, comprehension, and so on--which they do--and still have no idea if the kid can write. The writing needs to be clear and logical, but what's clear and logical in an essay is by no means as straightforward as what's clear and logical in a physics problem solution.
What I'm trying to say, really, is that there is probably a bias towards math at least in some part because basic-level math is very easy to grade and evaluate, whereas to judge writing is more nebulous.
Re:Gordon Rules (Score:3, Insightful)
The SAT is a failure (Score:5, Insightful)
Re:misuse of test (Score:4, Insightful)
With respect to rules and pedantry,
This quote from "The Elements of Style" [bartleby.com] should make it clear that rules are made to be broken - but only advisedly. It is the reason Hemmingway was, and will remain, a better writer than any computer. And why it is sometimes OK to start a sentence with a conjunction. Or why it is acceptable to callously split an infinitive. (Which is not a crime in English anyway unless you think English is actually Latin - which it isn't.) But none of this matters in a standardised test because they are testing competence not brilliance.
Re:Sensationalist Journalism (Score:3, Insightful)
Actually, tests aren't all that trainable (Score:4, Insightful)
The primary alternative to test scores are grades, which are even worse. They are extremely coachable, greatly influenced by third parties (parents, tutors, smart friends), subject to teacher ass-kissing, and are often a measure of attention to detail and willingness to do the grind rather than mastery of the material.
Re:Sensationalist Journalism (Score:5, Insightful)
First of all, multitudes of people taking the SAT either lack the skillset required to complete the essay section sucessfully or aren't specifically prepared for the test.
It's not about being a good writer, or being prolific, or even conveying your thoughts. It's only about writing to the test.
Therefore, it's insane to make serious literary criticisms on these writers when they're doing no more than plugging in their personal experiences and bits from US Hisotry to answer the questions. Even the best writers don't necessarily do well; many of my friends, who are much better writers than I, didn't do anywhere near as well as I did. I'm the first to admit I'm not a particularly good writer. But it's not about writing. It's about plugging the test prompt into a preconcieved formula and outputting whatever gobblygook you have to based on the grading rubric. So there are basically a plethora of flaws here.
Looking at more criticism:
"What does this really demonstrate? It's hard to say. Probably, that students who do well on the SAT writing test will also do well writing college application essays. Also, I'll bet that the tactic of Essay #2 (and to a lesser extent #3) will serve as the template for all future test-prep classes, and SAT graders of the future will come to cherish the increasingly rare students following the lead of #4."
Going through the college application process myself, I can tell you that what the college admissions professionals look for is nowhere near the same as what the SAT people look for. The SAT graders are simply looking for compliance with a strict formula and a specific sort of writing. It doesn't delight them to have a new, insightful, or personal spin on things. These "creative" touches simply throw them off their schedule - the graders, even those that grade online, have a cue in the form of a stopsign that warns them if they're going too quickly or too slowly. And the graders themselves get penalized if they grade an essay too far away from the other graders (each essay is graded at least twice). Furthermore, the lowest scoring students (as alluded to in the NYT) just ramble on about themselves or their lives, without relating back to the topic. The graders see far to many of these ineffective essays, so it's both dangerous to write one and dangerous to say that the graders like it when they're written.
What this amounts to is a strict penalty for those essays that are either personal or creative, both qualities that college admissions officers laud.
As for predicting that future test-coaches will advise you to take the tact of essay #2, that is, providing a personal and a literary set of anecdotes, I can assure you that such a strategy HAS been in place for quite a long time. I formulated a basic outline before I even BEGAN studying for the SAT's, because the format on the test is the same as EVERY OTHER type of high school writing prompt in the world. I have taken writing tests in two different states - Florida and Virginia. The tests are indistinguisable from each other. These types of prompts have been around for a while, and are here to stay.
~R
Re:Training For The Test (Score:3, Insightful)
Fallacy of the excluded middle. A well-designed test can and should test for education, not random teachable facts. It is entirely possible to write such a test. School teachers and college professors do so every day. If the state's board of education can't do the same, the fault lies with the test writers, not the good concept of giving tests and the good concept of testing everyone on the same basic material.
If your test is written correctly, the only way you can train kids for the test is by giving them an education and a true understanding of the concepts.
Re:Sensationalist Journalism (Score:2, Insightful)
Re:Sensationalist Journalism (Score:3, Insightful)
> It doesn't delight them to have a new, insightful, or personal spin on things.
The same can be said for TAs, as you will no doubt soon find out. The sad fact is that until you get farther along, and then only if you're in a field that rewards creative writing, you will do far, far better by sticking to formulaic "intro, 3 points of proof, conclusion"-type papers that state your position so clearly you can read it 40 feet away than you will by putting your 'personal spin' on things, because no one is interested in your personal spin on things - they're interested in seeing whether you can make yourself understood. After that's accomplished, then you get to put your personal spin on things, and people will pay attention.