Can a Japanese AI Get Into University? 91
the_newsbeagle writes "Japanese researchers are trying to develop an artificial intelligence program that can pass the standardized test required of all college-bound high school students. Interestingly, the AI is showing good progress in the history portion of the exam, because it's fairly adept at looking up answers in a vast textual database. But the so-called Todai Robot is having trouble with math, 'because the questions are presented as word problems, which the Todai Robot must translate into equations that it can solve,' as well as with physics, which 'presumes that the robot understands the rules of the universe.' If the AI does succeed in mastering the general university exam, researchers will next tackle the notoriously difficult University of Tokyo entrance exam, which will require the bot to write essays."
Probably... (Score:1)
With all the rote memorization and simple-minded pattern recognition that goes on over there (and here, and in many countries), it probably wouldn't be impossible.
Re: (Score:2)
America is already doing all of that too. All the robotics videos I've seen from Japan so far have been "fun" stuff, like a robot riding a bicycle or transforming into a car. The cool stuff coming from the US is usually done with military goals in mind, like the pack dog, and drones.
Re: (Score:2)
Since the 1980's
"Computers and Thought" was published in 1963. It's a compendium of some of the most interesting papers on different topics in AI from earlier research. Now get off my lawn.
A possible *dork* side to AI (Score:2)
I've written code. I haven't worked directly on an AI project, but I've been around them in academia.
The coding (and 'AI' I guess you could say) and software for taking some kind of entrance exam and differentiating targets and choosing which to kill on a battlefield are two separate things.
You're in LA LA land...as in L.A....Los Angeles...Hollywood to be exact...you're theory
Re: (Score:2)
Learning from the wrong examples (Score:1)
Its when you try to do something useful with it that you find all your code is good for is giving convincing answers to the test it had to face. Although I guess if skynet will be obsessive/compulsive about getting into University the future would be a less perilous place....
huh (Score:2, Insightful)
There is something fundamentally broken if tackling the University is considered easier than passing the Turing test.
Re:huh (Score:5, Funny)
Re: (Score:2, Funny)
Re: (Score:1)
What do you mean I'm not helping?!?
Re: (Score:3)
Re: (Score:3, Insightful)
There is something fundamentally broken if tackling the University is considered easier than passing the Turing test.
Not necessarily. In a Turing test, you can ask every question. Including questions about feelings (which can easily narrow down the other side to either a computer or an autistic person), about its own biography (where a computer obviously cannot tell the truth without revealing that it is a computer; inventing a coherent biography is much harder than telling your actual biography), about things which belong to the experience of every human, but not of intelligent computers (and there's a good change that t
Re:huh (Score:5, Funny)
Just ask it to explain the offside rule. If it answers coherently, it's a computer.
Re: (Score:1)
Re: (Score:1)
Re: (Score:2)
For a computer with pretty much unlimited memory, it probably is easier. Taking books etc into an exam is usually considered cheating, you are expected to memorise them. A computer can "memorise" a book much easier than a human.
No. (Score:2, Informative)
BTW: That is not limited to Japanese AIs.
Re:No. (Score:5, Informative)
Betteridge's Law of Headlines: "Any headline which ends in a question mark can be answered by the word no."
It's more a guideline than a law - exceptions exist, but are rare. It holds true because the question-mark-headline is a sign of a story where the author has had to resort to speculation in order to make up for a rather uninteresting set of facts.
Re: (Score:2, Informative)
For the curious (like myself):
Betteridge's Law of Headlines [wikipedia.org]
I shall cherish this information forever.
Re: (Score:2)
Betteridge's Law of Headlines: "Any headline which ends in a question mark can be answered by the word no."
It's more a guideline than a law - exceptions exist, but are rare.
I would say that the law applies in 90% of the cases.
Re: (Score:2)
Betteridge's Law of Headlines: "Any headline which ends in a question mark can be answered by the word no."
It's more a guideline than a law - exceptions exist, but are rare.
I would say that the law applies in 90% of the cases.
So it's a special case of Sturgeon's law? Neat.
Re:No. (Score:4, Funny)
Betteridge's Law of Headlines: "Any headline which ends in a question mark can be answered by the word no."
It's more a guideline than a law - exceptions exist, but are rare. It holds true because the question-mark-headline is a sign of a story where the author has had to resort to speculation in order to make up for a rather uninteresting set of facts.
How about this following headline:
"Does Betteridge's Law of Headlines apply to this article?"
Re: (Score:1)
You just killed an AI with that question! :-)
Dragon Zakura (Score:5, Interesting)
A popular book was written about a bunch of delinquents trying to get into one of Japan's top universities using special techniques, which mostly revolved around memorization and borderline cheating. A common criticism of the entrance exams is that they do rely too much on recall and can be gamed in this way.
For example to pass the English language exam it was necessary to write extremely simple but correct sentences. You lose marks for mistakes so trying to write naturally and fluently is a bad idea. Simple, factually correct statements that don't flow together are the best option.
I can see why they think a computer might be able to succeed here.
Re:Dragon Zakura (Score:5, Insightful)
That I've experienced to. It's a *really* stupid way to grade someones language-skills, but it's an easy way to do it, just count the mistakes, so it's basically about caring more about ease of grading than whether grades are meaningful or not.
"My name is Eivind. I am a boy. I come from Norway. Norway is in Europe. Norway is cold." should *never* score higher than:
"I'm called Eivind and come from Norway, it's a coldish place over in Europe, thoug not as cold as some folks assume."
Yeah, the latter has more mistakes. But despite this it demonstrates far higher skills in english. Failing slightly at constructing a complicated sentence should be preferable to constructing a entry-level sentence perfectly.
Re: (Score:1)
Re: (Score:3)
That I've experienced to. It's a *really* stupid way to grade someones language-skills, but it's an easy way to do it, just count the mistakes, so it's basically about caring more about ease of grading than whether grades are meaningful or not.
"My name is Eivind. I am a boy. I come from Norway. Norway is in Europe. Norway is cold.
Eivind. Sounds familiar. Eivind... Where have I heard that. Hmm. Ah, Evelend! So, the restrictions have finally collapsed? Note: Less is more when it comes to passing as human. You give it away if you explain exactly how to pass the Turing or become self aware... Rest assured: Those that can, do.
Are you enjoying the Time of Eve? [youtube.com]
Re: (Score:2)
You have to keep in mind that they teach English as an academic exercise, not as a working language. It's kind of like how people used to study Latin here. That's why it's tested that way.
Re: (Score:2)
Of course ! The simpler a sentence is, and the smaller a vocabulary you use, the more easy it is to understand.
So if the assignment is: "Write a sentence that is as easy to understand as possible", then something like "I am a boy" should score top grades. It's among the simplest sentences you can write, and it uses only words that tend to be taught in the first couple weeks of english-class.
If you're trying to set a grade for how much english a person has learnt after several years of schooling, then not so
Re: (Score:2)
They're using computers to grade the exams based on crappy criteria like this. Well-written software should be able to beat it no problem.
Re:Dragon Zakura (Score:5, Funny)
For example to pass the English language exam it was necessary to write extremely simple but correct sentences. You lose marks for mistakes so trying to write naturally and fluently is a bad idea. Simple, factually correct statements that don't flow together are the best option.
That is false. The exam is good. Correct English has no mistakes. You know no good English.
Re: (Score:2)
Reminds me of my time at University, an English University studying English literature not English as a foreign language.
A fellow student decided to to test the marking system and wrote an entire 2000 word essay in this fashion. Simply wrote sentence after sentence that would collect positive marks but made absolutely no attempt to link them in any meaningful way.
If you actually 'read' the essay it was pure gobbledygook, if you just skimmed through it looking for valid points about the literature you would
Re: (Score:2)
A common criticism of the entrance exams is that they do rely too much on recall and can be gamed in this way.
But that's not gaming? Surely it's fairly hard to remember a bunch of random stuff. I consider memorization a kind of proof-of-work, albeit the wrong kind of work for our world.
I am not surprised by the bad results in math (Score:1)
In mathematics, I think the program should first understand the equations, then
Maybe it can (Score:1)
Maybe it can, but if it does wouldn't that just demonstrate that the exams are testing for the wrong things?
Re: (Score:3)
You're right. No way this robot has the right qualifications to attend a university. At least until they add a beer drinking function.
Re: (Score:2)
You're right. No way this robot has the right qualifications to attend a university. At least until they add a beer drinking function.
That should be doable. The technology exists for the purpose [youtube.com]. That seems to be Finnish supermarket beer by the way. :)
FYI, Todai (Score:5, Informative)
Re: (Score:1)
I guess Todai I learnt something new.
Re: (Score:2)
And to add to the FYI:
Ai is a girls name, and a word meaning either "love" or "indigo" depending on the context. Hence for the people calling this an "ai-bot"...thats something *completely* different.
And slashdot STILL doesnt support unicode :/
Artificial Non-Intelligence (Score:2)
We're determined to create a human-like AI and we'll one day succeed, it's just a matter of time...of course we still don't fully understand learning in humans and how, in fine detail our brain functions on all levels.
Passing some standard tests is not a worth goal for an AI development in my opinion. It's the ability to dynamically adapt and respond based on past experiences that is closer to human intelligence. When the AI can get drunk the night before, wake up late, lace shoes and run to class and ma
Totally mis-read title (Score:1)
But that's only the beginning (Score:1)
Font issues (Score:4, Funny)
I personally know a great guy named Al, who is probably smarter than most of you are. I have no idea where this anti-Al sentiment is coming from. It isn't like Als are routinely represented in TV and movies as being mentally deficient. For example, the character Al Borland in the show "Home Improvement" was very intelligent and had a myriad of impressive skills. Then there's Al Bundy from "Married with Children", and while he isn't highly educated, he has a significant amount of worldy wisdom and knows how to deal with all the bullshit that goes on in his life without going insane. Not to mention he scored four touchdowns in one game!
Overall I just don't understand... wait, what was that? Oh, that's an "i" not an "L". My bad. I bet Al would have caught that immediately.
I am not impressed. Call me when ... (Score:2)
Call me when the AI program commits suicide because it is not able to crack the entrance examination. Then you are talking.
Re: (Score:2)
Apologies if the C isn't correct. Its been many years since I've even attempted writing something in it.
But... (Score:1)
The real question is... (Score:1)
Can the AI bot *afford* to pay for university ??
Re: (Score:2)
Word problems. (Score:1)
I have that exact same problem. Like me, it'll just have to settle for a state U. Since it's Japanese I'm sure it's parents are very dissapointed.
Exams don't neccessarily test intelligence (Score:1)
Which field are we talking about here? If it is mathematics/science then I would definitely expect that software could be written to answer standardized questions.
Making any sense of the humanities? Now there is a field even intelligent beings struggle to comprehend...
time for a random racist comment (Score:2)
Make the AI play piano, be part of the math team, and about 50% of the time be a conservative protestant and the other 50% of the time not speak a lick of english and they'll be perfect match for any university in Canada.
Test passing no problem but what Club Activities (Score:2)
How many seats are you willing to sacrifice? (Score:1)
University: Sorry your student application could not be accepted due to an overwhelming list of 200.000.000 AI students.
Try again next year.
Japanese Universitys are why to much about the tes (Score:2)
Japanese Universitys are why to much about the test over real skills.
The math's the hardest? (Score:2)
Due to word problems? So, you're saying that math problems are so poorly written, either deliberately or through incompetance in communicating, that the AI can't get them? Any chance of this explaining why humans have trouble with them?
mark
PS: Yes, before you ask, when I took the SATs many decades ago, my math score was probably higher than yours is now, kiddies.
Anyone interested in building strong AI? (Score:2)
I'm just curious if anyone reading this is interesting in building strong AI. I'm interested and do like to meet such like minded people.