GRE Computer Science Exam Canceled For '02 228
An anonymous reader writes "This may be a bit dated, but the Educational Testing Service has canceled the Computer Science GRE exam for November due to the fact that students were sharing and posting exam questions. One has to wonder about the immediate effect this will have on grad school admittance, as well as the long term changes that will likely occur to the tests as a result."
sharing? (Score:3, Funny)
How much do the scores count? (Score:2)
Derek
scores (alone) are used in 2 main ways (Score:3, Insightful)
Second, scores may be used at the high end to get considered for fellowships and other academic awards.
Most schools do not use the scores alone, but consider the whole package. Still, scores and GPA are used most everywhere in the initial sorting of applicants. If you are on the admissions committee of a CS department, and there are 3 of you, and there are 300 applications for 20 spots, you are going to want to winnow the pile in *some* way.
Keep in mind that standardized test scores do an ok job of predicting success in school at the high end, but do a very poor job of predicting failure in school at the low end.
"Education is not preparation for life, education is life itself." John Dewey
Re:scores (alone) are used in 2 main ways (Score:5, Informative)
This is not always true. In fact, I would say that this is far from the truth when it comes to the GREs. Being in Grad schol myself at a large state school I have a friend whose research advisor happens to also be the graduate advisor for the largest department on campus. This department recieves MANY applications from Asia and the GRE scores are a joke. Almost all of the applicants have a 99% percentile on ALL three sections of the general exam. And yet when they come here they can barely speak english.
My friend was asked by her advisor which applicant she would pick out of the scores and she pointed to the individual with the low score. She said that he probably earned that score. Most schools know about the score inflation caused by Asia and take that into heavy consideration.
If your going to apply to graduate school, especially for the sciences, then GRE scores should be the last of your worries. The best thing you can do is take as many classes in your field as possible. Get involved in some type of research: REUs, ERULF, etc. And when you apply show that all you want to do is research, research, research. Make sure you pick out a field (doesn't matter what really) within your discipline and show that you have some interest and knowledge in that section.
FYI, there are ethical Asian students too. (Score:2, Interesting)
And go easy on the sweeping generalizations. Maybe you are unaware that English is a first language in some of the countries from asia.
I did my undergrad from a well-known premier technology institute in the South Asian subcontinent and every EE and CS grad I knew there really earned his/her GRE score. Most of them were truly brilliant, had a firm command of English and I couldn't possibly imagining any of them cheating for a few extra points. They were ethical and proud brainiacs. Or perhaps I was lucky to have moved in such good company. I wouldn't deny that there were also other lesser mortals who cheated using all these cheap tactics as discovered by the ETS. But you be careful before making any sweeping generalizations.
Re:FYI, there are ethical Asian students too. (Score:2, Informative)
Re:GRE ha ha ha, but you'd better take it seriousl (Score:2)
Re:How much do the scores count? (Score:1)
Most schools do not require the GRE computer science test. I am currently in a graduate CS program and did not take the computer science GRE, only the general test.
Of course, taking the test can only help your application, unless you make a terrible mess of it.
Re:How much do the scores count? (Score:1, Interesting)
Many overseas master's students take this exam to try to place themselves in a good U.S. program. (which is understandable) I don't think all of them were cheating. It was probably only a few, but ETS needs to be able make sure that all students have a fair chance.
Yes, I have taken this exam.
Yes, I got my a** kicked by it.
Yes, I got into a good Master's Program.
Yes, I got a job!
Go ME!
MS CS program required 50+% in CS GRE (Score:2)
Well, at least they passed the first question (Score:5, Funny)
1) Can you use a computer well enough to share information?
Seems silly - (Score:3, Insightful)
Unless the tests have regional forms in addition to the other multiple forms, this is either useless or a symbolic slap on the wrist.
Re:Seems silly - (Score:2)
Re:Seems silly - (Score:2)
That said, the GRE is a general test. I think it was alluded to that non-native english speakers do worse because of the language barrier, thus have to take the subject-specific GRE exam. It would follow, then, that there would be more of a need for this in non english-speaking locales.
Not a tragedy (Score:4, Funny)
I'm sure not all schools use this approach, but many do. Maybe we'll see fewer international students coming in this year. That will certainly be a loss, but like I said, I'm applying and I really don't mind a temporary loss of competition. ;)
Re:Not a tragedy (Score:2, Insightful)
That's a good point. Presumably, the people taking the test who sharing information are applying to graduate school themselves. I'd assume they'd also have a fairly good idea of how competitive the admissions process can be these days. How do they benefit by helping other random internet surfers improve their scores? Wouldn't that just dilute the value of the original taker's score in the applicant pool?
Sounds a bit like shooting ones self in the foot to me.
Re:Not a tragedy (Score:2)
Re:Not a tragedy, because you're from the US (Score:2, Interesting)
So no, it's not a tragedy because it doesn't affect students coming from the US, only those dirty foreigners.
Re:Not a tragedy, because you're from the US (Score:2)
Two points:
1. There are plenty of good schools for CS outside the US. People can apply to schools in their own country. Who said 'foreigner' meant "Not from the US"? If somebody doesn't have a good school in their country they'll have to wait a year which is not such a big deal.
2. I know it's a popular stereotype to portray people from the US as 'anti' anything that's not from the US, however the US is hardly the place to go if you're looking for an example population that hates foreigners. How many countries in the EU have recently had an election with popular candidates running on an anti-immigraton platform?
Selfishness is human nature, and you'll find selfish people in any country. Don't be so quick to label an entire countries worth of people because of what this one guy said.
Re:Not a tragedy (Score:2)
You can always pick up another language after you've got the theory down.
how the questions are made/scored (Score:2, Informative)
Second, it takes a fairly large amount of time to figure out how difficult/fair questions are for these tests. That is what the experimental section of the exams are used for. They corrolate your actuall score with how you did on each question in an experimental section and via statistics then determine how difficult that question actually was. Because this process takes time (even after you have written the question), a question needs to have an apprecable lifetime for the tests to continue to be fair and the scores to remain comperable from one exam to the next. In these respects they are different than the questions on a licensing test (which should test your practical ablities anyway) since aptatude tests require relative scores which don't drift from year to year, and licensing exams should determine how quickly you can diagnose/fix a problem or create a solution for a particular challenge.
Re:how the questions are made/scored (Score:2, Insightful)
GRE? (Score:2)
Could someone in the US please tell me what a "GRE" exam is? Do you have to take one of these there before going into Computer Science or something? I am about to graduate with my BCS and I have never heard of this thing.
Re:GRE? (Score:2, Informative)
Entrance exam to graduate school (for your Master's Degree).
Re:GRE? (Score:5, Informative)
These are very popular or fairly popular at least in the US
Re:GRE? (Score:3, Informative)
The Graduate Record Exam is a standardized test administered by the non-profit (yeah, right) College Board (same people who do the SATs). It's usually a required test for anyone wishing to gain admittance to graduate school. In addition to the general test, which tests language skills, basic math, and analytical skills, they also offer a wide range of subject tests. Some schools just require the general, some require both the general and subject tests. The cost for the general test when I took it was a whopping $90 or so. It's a grueling test that will ruin your day. Takes about 3-4 hours. The best part is that it's on computer and you get your scores instantly.
Re:GRE? (Score:2)
Which of course leads us to the question, what is an SAT?
Al.Re:GRE? (Score:2)
Re:GRE? (Score:2)
It's a grueling test that will ruin your day. Takes about 3-4 hours. The best part is that it's on computer and you get your scores instantly.
That way it can ruin your night as well...
GMD
Re:GRE? (Score:2)
I believe that's correct. When I took the GRE (4 years ago), there was a lot of talk that it was going to be available on computer. They were just starting to roll out the computer-based testing, and it wasn't available at my location. It probably still isn't available at a lot of locations.
Re:GRE? (Score:2)
A lot of people ignore the subject exams and concentrate on the general exams which are a better indicator of a students aptitude (IMHO). The main reason to require the exams is tradition and laziness. This is why the testing service will be in business for a very long time.
Re:GRE? (Score:2)
For me, standardized testing has been a Godsend, because I always perform at a much higher level on them (app. 2.5 GPA HS, but 30 ACT) and I receive opportunities (and unfortunately, expectations) that I wouldn't otherwise.
I've never understood... (Score:4, Informative)
At the graduate level, however, you're supposed to be doing research. How do you define what knowledge is prerequisite for doing research in computer science? You can't -- all you can do is interview the students, get a feel for what sort of projects they are interested in, and decide if those projects sound as though they would be worth a degree.
Maybe things are different in the US of A, but I don't think I would personally want to study at any institution which would admit me on the basis of how well I did on an exam.
Re:I've never understood... (Score:4, Insightful)
At the graduate level, however, you're supposed to be doing research. How do you define what knowledge is prerequisite for doing research in computer science? You can't -- all you can do is interview the students, get a feel for what sort of projects they are interested in, and decide if those projects sound as though they would be worth a degree.
Things probably are different in the USA. I should disclaim that I'm in Physics&Astronomy, rather than Computer Science, but I suspect many of the same things apply.
A student who goes to grad school knows that he wants to get into research, and, yes, that's what grad school is all about. However, it's the rare student who really knows exactly what he wants to do when he goes to grad school. Many will have some idea as to what field they want to go into-- e.g., in Physics, they may know if they're interested in astro, nuclear, particle, condensed matter, or something else-- and a few students will know what profoessor or project they want to work with, but it's the rare student that knows beyond that.
Part of the purpose of grad school is so that students can learn, in an apprenticeship sort of mode, how to go about doing research. As such, judging them on the ideas for projects they have isn't really fair. Yes, it would increase the quality of grad students, as only the very top ones would ever get in. However, undergraduate education does very little to prepare students for that sort of thing, as that is part of the purpose of graduate education.
On to the GRE's. In Physics, there *is* a core set of knowledge that "any" Physics graduate student ought to have. Indeed, most schools have core courses (or core exams) which the students must take beyond that, to get the basics of the field, before they can be admitted to candidacy (at which point, yes, it is based partly on their presentation of what they will do for their research, and thereafter mostly all they are doing is working on their research). This admission to candidacy will typically come after the student's second year of graduate school. The GRE's give some vague indication (up to the general utility of standardized test, which is a whole different debate) of how well prepared a student is to survive those first two years of graduate classes.
-Rob
Re:I've never understood... (Score:2)
This is not always true. For instance, my wife is studying to be a Clinical Psychologist, and to become a practicing Psychologist, you need to have your Ph.D. (though sometimes a Master's will work too). While it's true that you have to do research to get your Ph.D., a "Clinical Psychology" program exists to train Clinical Psychologists. "Clinical" specifically means you work with people to help them, not to do research.
That said, my wife did have to take the GRE as part of the application process.
Re:I've never understood... (Score:3, Insightful)
Re:I've never understood... (Score:4, Insightful)
With personal interviews, you get a lot more discretion in the interviewing, and you can get a lot more depth of information, so things are a little less arbitrary -- but then you get the biases of the interviewers; someone who one interviewer might think is brilliant, another might dismiss as a hack. So you get deeper, more nuanced information, but less uniform and differently arbitrary.
Don't forget that in the US, most students coming into Ph.D. programs are coming straight out of undergraduate, so there is a real question of making sure everyone has the same background, and the students aren't launched immediately into research the way they might be in a system where you do a Master's first. Also, in a field like CS, you have people coming in from Math, CS, Physics, or Engineering background, so a `level laying field'-test is a useful tool.
The GRE provides four numbers -- a score on a subject test, and scores on three general tests -- logic problems, basic mathematics, and english skills. All of those can be useful pieces of information -- a bright person who can't read or write is unlikely to be a good TA or, for that matter, work well in groups where reports need to be written often. A person who knows tonnes about their subject but can't solve simple logic problems is unlikely to be a really creative researcher, etc.
When you have 500 people applying to your department, and you can only accept 20 or so students, you need a quick way of pruning the list to 50-100 or so, who you can then start looking at in more detail. For that, you need a broad, uniform measure, which is exactly what the GRE provides.
I don't know any department that bases its acceptances solely on the basis of the highest GRE scores, and those who did probably deserve the students they get. (A Yale and Cornell study [cornell.edu] found that GRE scores corellated well with the students coursework grades, but poorly with overall sucess as a grad student). But it is a useful piece of information, and helps sorting through huge pools of applicants. Like any standardized test, the problems come when people take the tests too seriously, usually by assuming that the tests measure something that the test doesn't even claim to test for.
Re:I've never understood... (Score:2)
And yet, I've had several TA's like that, and I'm sure I'm not alone here...
Re:I've never understood...the point of GREs. (Score:2)
Undergraduate entrance exams make sense; they verify that you have the prerequisite knowledge to take (pretty standard) undergraduate courses.
On the contrary, undergraduate entrance exams do not make sense because (okay, I'm only talking about the SAT here - limited experience), because they are so easy that all you need to do is be a good "test taker" and you can own them. Being a good test taker basically means approaching every question with the attitude that you can get the right answer because one of the choices is right and you've been exposed to the information needed to find it at some point in the past (by 9th grade, 10th grade at the latest). Little actual thinking and knowledge are required to get any question on the SAT correct.
As a result, anyone can do well on an undergraduate entrance exam, not necessarily people who are either smart or a good student. GREs are a little different in that the material is "hard", but they're still multiple guess. The requirement of having a hard multiple choice problem means that most problems have to fall into one of a few patterns of "ways you can make a multiple choice question hard." So again, good test takers can own the tests. Except this time, the amount of knowledge required is higher, indicating that the taker may have had to learn something as an undergrad. This means the test does a better job of measuring if the taker is a good student: a person who can readily learn what they do not already know (and work hard). Remember, "smart" people are not necessarily what a school desires. Graduate schools are a little more keen to this and therefore don't require the GRE or subject GREs as often as they require SATs/ACTs.
Re:I've never understood... (Score:2)
Re:I've never understood... (Score:2)
GRE general vs. subject tests (Score:1)
Yeah (Score:1, Troll)
To think that GRE exams are being salted by massive P2P software is a bit misleading. The abusers of the system have been abusing systems for thousands of years; to think that this is a new phenomenon is foolish. That they would use P2P programs is to be expected, and that they would hide behind lies and grand mistruths is to be anticipated.
Ban them from the universities and kick them out of the country. If they are not in the country, ban then from ever entering.
so this means the testing problem is fixable? (Score:2, Interesting)
Even before students started sharing test questions on the internet, standardized tests only test memorization. It does is terrible job of measuring intelligence and critical analysis. Why in the world people believe SAT and GRE are useful is beyond me. Sure the system has been that way for a long time and everyone knows it's broken, but no one is willing to fix it. People with money to send their kids to test prep schools are the ones who benefit from standardized tests.
Not that anyone cares, but standardized tests were originally created to level the playing field for college admission. I forget who created it (saw a special on discovery), but the original intent was to make it so a smart poor kid could get into college. In practice, that is far from reality. Most of the kids who score well on standardized tests get the results because of test prep schools. People who are brilliant don't count, since they don't need to study in the first place. Children of those who make less than 50K have a harder time, since they can't afford it. I fail to see how paying for a test prep school, which use old tests for practice is different from kids posting the questions for free. Well, except that it negates the need to pay 2K for GRE prep class.
CS Students from Abroad Should Be Curtailed (Score:1, Troll)
Sorry. After being rejected from a whole slew of grad schools for CS, this is just the way I feel.
Select honest people (albeit with lower grades.)
Re:CS Students from Abroad Should Be Curtailed (Score:3, Insightful)
To be honest, unless you're interested in academia and research, there isn't much reason to get a CS Ph.D. From a job/financial standpoint, you might as well start working straight from college.
Heck, when I was in college it seemed like a lot of the CS majors were just there for the job prospects. Those aren't the type of people who go to grad school. You have to have a real passion for the subject to want to slog through N years of grad school. Or you have to really want the letters after your name. Otherwise it ain't worth it.
Re:CS Students from Abroad Should Be Curtailed (Score:2)
Re:CS Students from Abroad Should Be Curtailed (Score:2)
You might feel that would mean curtailing intake of foreign grad students. You'll have to explain that position very very well. The two statements are completely unrelated.
You'll also have to explain why US universities should be beholden to US citizens. US universities should work to become the best universities that they can.
After you show that, you'll have to prove that admitting fantastic foreign students does not improve the quality of education for the American students.
Re:CS Students from Abroad Should Be Curtailed (Score:2)
I agree with most of your points, but this one is pretty simple. In the case of private universities, the answer is that they shouldn't. In the case of government funded universities, they should serve the interests of the citizens that government represents and acquires those funds from.
Re:CS Students from Abroad Should Be Curtailed (Score:2, Funny)
Re:CS Students from Abroad Should Be Curtailed (Score:4, Insightful)
I'm sorry you were rejected from a whole slew of grad schools. I'm sorry your abilities, your knowledge and your intelligence were deemed inferior to a whole bunch of people inspite of the natural advantage you held as far as the language and accessibility of technology is concerned.
I'm sorry, universities are not run as a charity system. Most scholarships are paid for by industrial sponsors who want to see research results from their money.
I went to grad school at a top-10 school for CS. There is a whole slew of scholarships and opportunities that are available for US citizens and residents which are just not there for foreign students. As a result, many US students were admitted over much better international students. The few foreign students that were there were the cream of the class - and outdid most of the local students in terms of what they achieved for their professors and for the prestige of the university.
Deal (Score:5, Interesting)
I applied for grad schools about 2.5 years ago, and got 5 rejection letters...
Did I hate 'abroad students'? No.. I did research and grad classes for 2 years, and tried again, last winter, and had a choice between two top shcools, in a much tougher year for grad schools.. I still got 3 rejection letters, but I got in.
Another thing, if you're applying to top schools, try setting your sights a little lower. There are enough spectacular faculty that *any* top-40 school will have them.
Finally, remember, a lot of the application process is chance and brownian motion. If a faculty member is interested in your particular skills&background, spectacular, if that member isn't on the admissions committee this year, better luck next year.
Re:They are (Score:3, Informative)
As for selecting honest people, that's a noble sentiment, but it's difficult to determine honesty on an application, and it's not practical to interview all candidates.
MIT (Score:2)
Incidentally, MIT requires neither the GRE General Exam nor the Computer Science Subject Test of applicants to their CS grad program.
Re:CS Students from Abroad Should Be Curtailed (Score:2)
Short form: honest and hardworking students get screwed in their grades, while know-nothing slackers sail on by... Personally, I don't care if the system allows some slackers -- some will squeak through. I am bothered when they mass in such numbers that the real talent is trampled underfoot.
Re:CS Students from Abroad Should Be Curtailed (Score:4, Insightful)
I am a foreigner studying in US CS Grad School right now. I must say that it is more correct to take the _best_ students from whichever country they are, since they will add value to the department by doing better quality research, and also enhance the classroom experience. And the US Schools, in fact, really do that today - they take the best students.
I just feel that as we import more students, educate them, and then subsequently export them back to their country we have just devalued our own country a little bit more by shifting knowledge and skills to foreign lands.
Thats clearly happening. Lots of skills, knowledge, and technology is being transferred from the US to outside. But for a developing country like from where I am, this is important and very useful, and helps our country develop. Even otherwise, its good for society, since all countries should develop equally, right?
Also, many times, the foreign students do not go back to their country, so the USA benefits by having a high-skilled person added to the community...
So the present situation turns out to be beneficial for the US as well as other countries.
AP Tests anyone? (Score:1)
Oh my God!!! (Score:1)
programmers will be sharing code
Smacks of communism to me
The person responsible (Score:3, Interesting)
P.S.
Yes, I read the article. I took comedic licence with the facts. (I didn't like them, so I ignored them.)
-
Re:The person responsible (Score:2)
Daniel
(note to people not familiar with the GRE: a perfect score on a given section is 800)
Re:The person responsible (Score:2)
I know, I got it.
Height of naivete(sp?) (Score:2)
It is extremely naive to assume that students will keep their mouths shut after taking an exam. Of course they'll talk, discuss solutions and see how well they did compared to others.
I took the CS "AGRE" (as it was called then) in the 80s, and after we came out of the exam, we were discussing the questions and were able to reconstruct the entire exam (including the multiple choices) in a manner of minutes. An astute listener who was scheduled to take the exam months later could easily have obtained the list of 80 questions that we had. Of course, not all of them would have been repeated; but some might have.
Re:Height of naivete(sp?) (Score:2)
When I was an undergrad, I found that many cliques of students had access to past exams, answer keys, teacher's manuals, etc.
Pissed me off till no end that these bastards had an unfair advantage over me.
What a Racket (Score:2)
What a phenominal load of crap. Lazy admissions departments would just rather plug numbers into a computer than actually learn about potential students. Standardized testing is a self-fulfilling prophesy - skim off the top ten percent for the top ten percent of schools. Of course its gonna look like a success. But then again, a hundred years ago it was all about advancing the knowledge of humanity. Now it's just a hole in a punchcard. What a horrible waste of resources. To think, there is probable some kid out there willing to work his ass off to push the knowledge envelope, but he'll never get the chance because Podunk Community College doesn't have decent research facilities and Ivy University won't even look at somone without a high score on the monkey test.
Re:What a Racket (Score:2)
Give them a way to do so, and they might. But even if you drag student the thousands of miles it would take many of them to reach you for an interview, how much does that really tell you? Test numbers are somewhat reliable ways to pull the best students out of the mix.
skim off the top ten percent for the top ten percent of schools [...] Podunk Community College doesn't have decent research facilities
Right. I went to Podunk High School and scored very well on the SAT. I've taken a look at the GRE study guides - looks like the exact same type of test. You don't need research facilities; you need a brain. And Podunk Community has a library and Podunk State (right across the street) certainly does.
But then again, a hundred years ago it was all about advancing the knowledge of humanity.
A hundred years ago? "Hey, we got mail from Podunk!" "You mean that place that just became a state? I hear they actually let women vote. Barbarians." "They sent an application. Some miner who probably can't speak a word of Latin thinks he can join Ivy. What arrogance." And the application got trashed.
Are people less ethical now than they used to be? (Score:2, Interesting)
So what? (Score:2, Interesting)
Re:So what? (Score:5, Funny)
Yeah, I had the same teacher, and it was tougher than just that.
The three questions were actually superpositions of the 100, so you wouldn't know what they were until you observed them on the test
Re:So what? (Score:2)
The three questions were actually superpositions of the 100, so you wouldn't know what they were until you observed them on the test ;)
Yeah, and every time you re-read the problem, it would change on you!
GMD
This quote makes my head hurt. (Score:5, Funny)
So in years past, they *have* given an April 2003 Computer Scienct Test?
affecting admissions (Score:2, Interesting)
On the other hand, my test date is Dec. 14 (the Nov. test was cancelled, and there are no other test dates between now and then). Admissions applications for one of the schools I'm interested in is Dec 15th. So I sort of have to hope that a lot of other people are in the same boat, so that my already meager chances aren't flattened by this mess.
Re:affecting admissions (Score:2)
Missing the point (Score:2, Insightful)
Okay, so it sucks to be an honest person trying to take the exam in China or India; hopefully there'll be enough upset people that they'll go let the jerks who did break their agreements with ETS (which you have to sign before you're even allowed into the testing site) know just how unhappy they are. For the rest of us, I'm glad to see that ETS is enforcing their agreement; it means that when I start applying to PhD programs, the admissions committees will not be comparing my ability to do well on the GRE with other peoples' abilities to cheat their way to the top.
More importantly, were you on an admissions board, would you want candidates who have shown flagrant disregard for non-disclosure agreements (which is a large part of the contract you sign with ETS as a test taker)? Do you want people who have shown themselves to be unethical, especially with recently exposed cases of scientific fraud, entering your professional societies and being associated with your programs? The answer should be no. It doesn't matter if the people involved in the cheating consider it to be wrong. It doesn't matter whether or not, within their cultures, what we in the western world consider to be cheating is perfectly fine. The fact remains that when you apply to a school in America, you will be held to American standards; the same is true for any other country.
Other cheating... (Score:2)
I'm sure that it's pretty common especially given the insane scores of some people on the exams. I've seen a lot of CS grad school applications where the scores do not match the person who shows up. I mean there are some seriously stupid people who have 99% on EVERY section of the GRE. Most often, you'd see someone with a 99% on the English portion of the test who'd show up and have an obviously low command of spoken and written English. Typically this was most obvious in Chinese students -- too bad because this is probably one of those "one bad apple" problems.
Of course I disagree with the whole idea of the CS portion of the exam. I mean I remember some stuff on there was just bizarre. Karnaugh maps and crap like that -- who cares?
Re:Other cheating... (Score:2)
Nonsense. I had perfect scores on the Quantitative and Analytical sections and that only qualifies for a 98%ile.
If the general math standards weren't so pathetic in the US, maybe the Quantitative section wouldn't be the joke it is right now.
The GRE-CS dates are ludicrous to begin with (Score:2, Interesting)
The GRE CS Subject test is (with the exception of this year) offered in April, November and December. Most applications for graduate programs are due in December (or Jan.1 at the latest). I was just starting to prepare for all of this in April, and was shocked to find that there were NO dates for the CS test (which is required or 'strongly recommended' by all the schools to which I'm applying) until November. Since it's a paper-based test, results take 4-6 weeks or so to get through to the schools. Which means that even taking the test in November, there's a chance that your school of choice won't get your CS scores by Dec. 15, a popular application deadline.
WHY? Why on EARTH would the test be offered in December and not, say, July or August? Is it just done that way to make life more frustrating for grad school applicants?
And now, on top of this, the november test is canceled. Thankfully, all the schools to which I'm applying said they're going to happily take late scores this year due to the cancellation, and that it won't affect my application process, but I must say it's driving me nuts that I'll still be worrying about and studying for the CS exam in the final weeks of the application process, when I'd rather be speaking with professors, gathering recommendation letters, and working on my statement of purpose. Instead, I'll still be making sure I've got the ins and outs of compiler design and plenty of other areas of CS that I don't ever plan to really study in depth fresh in my mind, and I won't even know what my scores are before I send in the application.
Oh, well. That's enough crankiness for one morning.
-Dan.
It's not just ETS, it's the whole testing industry (Score:2)
Flash forward to now, where all the testing is outsourced to Prometric and other companies, who further outsource it to Mom 'N' Pop's MCSE Training School. Who's keeping them honest? The questions are downloaded right to their server; what's to stop them from selling them to whoever wants them?
The number one thing that killed the MCSE as a valid credential was the braindumpers who had access to the exam questions, or who could take the exams over and over again under the "old" retake policy. And given that Transcender makes tons of money selling practice tests, I'm sure they sent in a few test takers of their own. The same could be said for Kaplan.
Add this to the fact that many MCSE cheat schools have been busted for taking the exams for students, giving them help, etc. Makes you wonder how much is being leaked...
Granted, the general section of the GRE is an aptitude test. The only possible advantage you could have is access to the reading passages beforehand, or knowing what the logic questions looked like. But buying a test prep book gives you a general idea of what you see. However, the subject test is quite another story. That thing was a bear, and I was a good chemistry student. Several hours of random trivia questions, some in subjects we'd never even covered. There, access to the material beforehand would be a cheater's dream come true.
Re:It's not just ETS, it's the whole testing indus (Score:2)
While the tests themselves aren't being outsourced, the administration of them is, including proctoring, etc. Therefore, I see big security holes. Back in the paper administration days, ETS actually brought in their own proctors to handle security, etc. Now, you have two problems. The test is available whenever you want, and you can take it once a month, five times a year. This helps the braindump people. Second, the test center has a copy of the questions sitting on their super-secure file server, just waiting for an employee who wants a few extra bucks to pick them up.
how admission actually works (Score:5, Informative)
Admissions to a research program, like ours, is based on a bunch of different things. A good way to think of it is that your statement of purpose and your letters of recommendation are the things that build your case and everything else is an opportunity for you to shoot yourself in the foot.
First, on behalf of every professor inundated with e-mails, let me say that there's no benefit, whatsoever, in mass e-mailing every professor on the planet to see if they're interested in you. However, if you have a particular research interest that matches a particular professor (say, security of peer-to-peer systems or of mobile code systems, in my case), then do send that one professor a personal e-mail.
So, then, what makes for a good statement of purpose or good letters of recommendation? I always look for evidence that you've got technical interests beyond what you've done in class. I also look for evidence that you didn't just go to "how to get into grad school" school and follow their instructions blindly. Some of these letters just stink like they came from an insert-your-name-here template. Don't tell me "I have lots of energy!" Describe all the work that your energy has produced. Likewise, in many countries, it's customary for the student to write letters of recommendation on behalf of their advisors, who just sign them. Make your advisors write personal letters.
So, what value are the GRE scores? For the General GRE exam, there's some minimal value if the applicant is from the U.S. or Europe, but absolutely zero value if the applicant is from India or China. I don't know what they do over there, but every student seems to ace the exams, probably because they study so hard for them. The exams, thus, aren't measuring anything more than rote ability.
The CS subject test used to actually be useful and a strong score there would catch my attention (and a weak score was a huge red flag). Now, without that, we'll probably end up looking more at transcripts.
Still, let me emphasize, the best way to impress somebody like me is not with good grades or test scores, it's with research and technical experience beyond your class assignments. If you've worked with a professor on a research project, or if your code has found its way into the Linux kernel, that will get my attention (and I'll go look at the source to make sure you're telling the truth).
Obligatory plug: I'm looking for good security-minded students with strong backgrounds in systems and/or programming languages. If that's you, contact me [rice.edu].
Re:how admission actually works (Score:3, Interesting)
> every student seems to ace the exams, probably
> because they study so hard for them. The
> exams, thus, aren't measuring anything more
> than rote ability.
You're a very upbeat guy, Dan! I mean, optimistic. I'll tell you how it works -- they cheat.
I live in Taiwan and have a sister-in-law who is studying to take the GRE. The advantage in Asia (India?? -- I think this is a Rumor!) is that they have "Teachers" that take the GRE test every few months on the computer. While they are taking the test, they memorize in their heads each question. Once they're done they come back out and teach 2 month long classes for big $$$ to the students.
I don't know what the history is as far as what cancellation came first, but the GRE people have cancelled the Computer-based General test for the express purpose of reducing continuing cheating that happens in Asia.
Everything in Asia is now written and its going to stay that way for a long time. This is why previously any GRE scores coming from Asia has zero value!
Good. (Score:2)
Not the best-run test anyway. (Score:2)
So I took the exam again April of 2002 and noticed that one of the questions had two correct answers. In fact, it was the only programming question on the exam and it was pretty trivial.
The test was on a Saturday. So I get ready to send a letter to ETS on Monday, when I find scores in my mailbox. "Man, a 2-day turnaround? When did they become efficient?" I thought. It turns out they were revised scores from the April 2001 test, which they had graded wrong. My score jumped to upper 90s without my doing anything. "Don't worry, we'll send new reports to all schools you sent your scores to", they said. Great, a lot of good that does me in April.
I sent in the letter, they admitted the question had two correct answers and wouldn't be scored, and I eventually got back scores, which were exactly the same as the revised 2001 results.
So, moral of the story -- don't take the test twice. Just take it once and assume that something will go wrong that's not your fault.
Age-old problem (Score:2)
The best way to assess somebody would be to work with them in a long-term project, but that is not practical on a mass scale.
The best we can do without breaking the bank is a combination of interview, references, and testing. This is just what most colleges use.
If you have a magic solution, then lets hear it.
It is one of those things that are easy to gripe about, but hard to solve in practice and/or on a long-term scale. World hunger also fits that bill, BTW.
Test ability ... not memory ... (Score:3, Interesting)
Please note, that I have never even seen these tests, nor know anyone who has ... but I'll still pipe in :)
Instead of keeping the questions and answers "secret" ... create something like the amateur radio community has ... a large question pool (which is published), with a very limited number of questions actually asked.
The reasoning behind it, is for the sake of easily administering tests. Everybody knows the questions involved, and what you need to study is the theory behind it, not the answers ...
Now for something like this, you would have to have a HUGE question pool for each section, just to make sure that nobody knows WHICH question will be asked ... just make sure that you know the theory behind the question.
Obviously, you'll run into problems with programmable calculators being brought in, so a way to fix that would be to supply calculators (if necessary) that have all of the capabilities required.
Anyway ... just my thoughts on the process ...
Never happened before (Score:5, Informative)
In high schools, first period Chem students would share info on the test to the later period Chem students. How much info can be retained with so little time to cache it?
Was it actual test questions? Or just pointing people in a more focused direction?
How many tests have you taken where half of the "knowledge" was "researchable material?" What year did the OSI model come to be? That was an exam question I faced on a multiple choice exam. I wrote in my own answer . . . E) go look it up because I don't need to know that to set up a network.
Re:Never happened before (Score:2)
Re:Never happened before (Score:3, Insightful)
Yes - I realize the order of the questions - and even the selection - varies from form to form. There wouldn't be just 1 person memorizing question #2 - there would probably be 50. So you might get 10 different answers 5 times each - but the point is that you would get the questions.
I believe the questions are rather heavily recycyled - that is part of the benefit of hte tests since you can use the recycled questions to compare results across multiple editions of a test, or between years. If every test were completely unique, it would be harder to determine whether one edition was harder than another. Sure, you can look at the mean, but that assumes that student performance does not change from year to year. In fact, one of the best uses for standardized tests is to test the educational system itself by seeing if this is in fact the case.
Re:Never happened before (Score:3, Informative)
The mainstream study sites make up their own questions, which is no different from old school study guides. They can't use exact questions, and all the guides tell you they are not exact questions.
no crap (Score:3, Informative)
So the real issue isn't forcing quality of students, it's a way for the university and a 3rd party to scam a little cash before taking the next 2-6 years of your life. People really don't realize how poorly this test reflects ability - when I first took it, I took it cold and got a 1300 on it. I bought a cheapo study guide and then made a 2200 on it. The only thing I did was practice a little on the included online adaptive program and look at some of the TRICKS at getting quick and easy answers.
GRE really does make sense! (Score:3, Informative)
Wait. You are wrong here.
Dozens and dozens of my friends and acquaintances (and myself) have taken the GRE, and based on their results, I can assert that, given that you study for the test seriously, it reasonably estimates your general aptitude. And that a GRE score is a reasonable measure of your academic skills, which when used along with other application materials, is really useful for admission decisions.
And the GRE Subject Tests are even more useful, since they objectively measure domain-specific knowledge, and tell you how much a student really knows about his subject. (cant rely solely on GPA!)
More importantly, however, there is one very significant positive point about the GRE, which just cannot be put down. The applicants to US Graduate School include a large number of students from dozens of different countries each having its own peculiar education system. Its almost impossible to compare such students coming from schools which the US schools have never even heard of before, let alone having some knowledge about their education quality. The GRE and other standardized tests are most helpful in this area because each and every student across the world has to give the same test, and hence the scores can be used to compare students coming from very different backgrounds.
Re:GRE really does make sense! (Score:2)
So the real issue isn't forcing quality of students, it's a way for the university and a 3rd party to scam a little cash before taking the next 2-6 years of your life. People really don't realize how poorly this test reflects ability - when I first took it, I took it cold and got a 1300 on it. I bought a cheapo study guide and then made a 2200 on it.
Wait. You are wrong here.
Wrong about what? His scores? You should specifically state what you are objecting to.
Dozens and dozens of my friends and acquaintances (and myself) have taken the GRE, and based on their results, I can assert that, given that you study for the test seriously, it reasonably estimates your general aptitude.
So you can "assert" that this is a good test of aptitude based on a sample size of "dozens and dozens", huh? Gees, I sure hope you didn't pass the GRE Statistics test with flying colors...
And that a GRE score is a reasonable measure of your academic skills, which when used along with other application materials, is really useful for admission decisions.
How many grad school admission boards have you served on? How can you make this statement?
Its almost impossible to compare such students coming from schools which the US schools have never even heard of before, let alone having some knowledge about their education quality. The GRE and other standardized tests are most helpful in this area because each and every student across the world has to give the same test, and hence the scores can be used to compare students coming from very different backgrounds.
That's a good point but the rest of your post is pretty lacking. Be a bit more careful in your responses.
GMD
Re:no crap (Score:2, Insightful)
As you rightly point out, the GRE scores are largely affected by how much preparation was made (e.g., by working through cheap guides). It is thus a measure of both talent and motivation (and perhaps free time available).
The GRE is good, not because it is perfect but because it can complement other imperfect alternatives. Grades are very difficult to compare and letters of recommendations all tend to be extremely positive.
I completely disagree with the scam suggestion. It is certainly true that the 3rd party makes money on the test, but are you suggesting that the universities get a commission - and that that is the reason why they use the test?
Tor
Re:Those darn hackers! (Score:2)
Re:Proposal for Exam Reform (Score:2, Informative)
Re:Proposal for Exam Reform (Score:2)
Very few people can make a career from Computing Science. I suspect you are a programmer with a CS education, though. The point of a university education, in general, is not to prepare people for jobs. The purpose of it is to educate people, to teach them to think for themselves, and advance the human race. Even though most people that go into university never go onto graduate work / research or make any significant contribution, having informed and intelligent people in the world is a good thing.
Take a look at it this way: if the sole purpose of university was to get you a good job afterward, arts majors would get good jobs too. The truth is that arts majors go to work at McDicks when they graduate. Computing Science is one of those rare fields that most of the theory is directly applicable to creating marketable products. That is not to say that CS isn't actually something that is worth being in a university rather than a college (colleges & universities are different here in Canada). Computing Science has a lot more to it than programming. Too bad you wasted your education.
Re:Proposal for Exam Reform (Score:2)
Well, I think there purpose is exactly what we're trying to find out. We aren't arguing the same thing now. I contend that arts majors getting shitty jobs is irrelevant since they are still educated people... that being the reason they go to university.
Setting exams that are easy to cheat is just one example of failure.
I think that is the symptom of our problem. Universities are overrun by people who go their to get good jobs afterward. Maybe that changes the definition of a university, maybe it doesn't. The conceptual model of a university has existed before the industrial revolution. Long before that, people didn't go to university to get a job afterward. I think this still holds true, even though that model is taking a beating. Now, a higher education is very important because of our competativeness with knowledge. But the fact that people cheat, and they do, shows that those people don't go for the education, but for the peice of paper that comes after. This peice of paper, as they see it, entitles them to a job. If people were going there to be educated, then they wouldn't cheat because there really wouldn't be any reason to. There still are other people that go university to get an education in something interesting. Maybe it's just me being a geek, but that's what it should be.
This really comes down to (excuse the pun) "new-school versus old-school". This problem has been beaten to death many times in many different forms and I don't think that we could every solve it through
As for CS being applied math, cooking is not applied math. I think the word "applied" is ambigous, however. Cooking utilizes math in its use, but it is not mathematical in nature. Exactly the same thing in general science. Studying our world through science can utilize math and create mathematical models of real life, eg f=ma. But, computing "science" is something completely different. It is itself a form of mathematics. It is just the subset of mathematics that can be performed on calculating machines. Algorithms, complexity, problem solving etc, is not utilized, it is its nature. The reason it is called applied mathematics is because it is not exaclty pure mathematics. Pure math has no direct application by definition.
Re:Proposal for Exam Reform (Score:2)
But you appear to have romantic notions about the role of universities.
Originally, guilds had their own schools. Skills were transmitted in secrecy.
Knowledge is power and status, power and status define success in our societies.
Universities were created by governments to take power away from the guilds.
Especially, and primarily by and for men.
(There are fundamental differences in the way men and women acquire and use status.)
Universities were created to channel, transmit, and often control essential knowledge.
Only a species on holiday can say 'unapplied education is worth something'. It is not, IMHO.
Re:Proposal for Exam Reform (Score:2)
I agree that strictly unapplied knowledge isn't worth much in a global sense. This doesn't say much about real life though. There are many places one can apply their knowledge. This could be by voting, public debate (sort of like this), or making rational decisions for example. Just getting jobs for students should not be the focus of university. I am not saying that the knowledge should or cannot be applied. I am saying that a university education should be at a different level than this. Getting prepared for life is not the same as getting prepared to work. If a university teaches in a field where there is very little work for their graduates, it is not a failure of the university. Marketable skills change over time and what might have been a very promising career could be worth peanuts tomorrow. Market trends should not dictate human knowledge. We should not abandon seemingly useless subjects so that students can learn what is best for the economic viability of their nation. That is not what being educated is really about.
A job should really be an independant bi-product of a university education, not a result, if it were in the right field. That is why here, in Canada, universities and colleges are treated differently. A university is about higher education and research. College is about preparing people for a career. It would be a failure for a college to not provide skills for a useful job, but not a university.
Re:Read the article!! (Score:2, Informative)
Microsoft revoked certifications. (Score:2)
Ok, that may not mean much to you, but some consulting companies require the certification so they can tell their clients "our consultants are all certified". I wasn't going to risk multiple certifications which took me a couple thousand dollars.
The sites that still exist in the open make up their own questions, which may be like the exam questions but are not exam dumps. That's how they still operate.