Stories
Slash Boxes
Comments

News for nerds, stuff that matters

George the Next Generation AI?

Posted by Zonk on Mon Sep 25, 2006 04:27 AM
from the george-and-alice-sitting-in-a-tree dept.
smileytshirt writes to mention a story on the News.com.au site about George the AI, the latest in a line of chatbots intended to mimic real human behavior. What makes AI George different than, say, ALICE is the recent addition of an avatar: a Flash animated body that reacts mostly in real time to the emotional impact of the conversation. From the article: "One can now have an oral discussion with him over the Internet, 'face to face'. George appears on the website www.jabberwacky.com and takes the form of a thin, bald man with yellow glasses who wears a white turtleneck sweater. He can smile, laugh, sulk and bang his fist on his virtual table. He can turn on the charm and wax romantic. But he can also turn coarse at times. It isn't as if George only learned good manners. "

Related Stories

[+] Interviews: Alicebot Creator Dr. Richard Wallace Expounds 318 comments
Okay, here are Alicebot inventor Dr. Richard Wallace's answers to your questions. You're about to enter a world that contains interesting thoughts on A.I., a bit of marijuana advocacy, a courtroom drama, tales of academic politics and infighting, personal ranting, discussion of the nature of mental illness, and comments about the state of American society and the world in general. Yes, all this in one interview so long and strong we had to break it up into three parts to make it fit on our pages. This is an amazing work, well worth reading all the way to the end.
[+] ALICE vs. ALICE 506 comments
new-black-hand writes "The A.L.I.C.E Bot-off has produced some interesting results. It basically involved taking two instances of the A.L.I.C.E conversation bot and pointing them at each other. The results show that the bot is not really that intelligent, and relies more on human input."
This discussion has been archived. No new comments can be posted.
Display Options Threshold:
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
  • OMG we killed him (Score:2)

    by MichaelSmith (789609) on Monday September 25 2006, @04:35AM (#16182725)
    (http://netapps.com.au/)

    The site is not coming up. Did George die for real in a hail of referrals from slashdot?

  • by 80 85 83 83 89 33 (819873) on Monday September 25 2006, @04:39AM (#16182747)
    (Last Journal: Thursday October 06 2005, @01:37PM)
    carpenter's latest creation won the latest turing test prize.
    http://www.technologyreview.com/read_article.aspx? id=17518&ch=infotech [technologyreview.com]

    george was last year's winner....
  • What?! (Score:5, Insightful)

    by archeopterix (594938) on Monday September 25 2006, @04:39AM (#16182749)
    (Last Journal: Wednesday January 08 2003, @09:48AM)
    Adding an animated cartoon is supposed to be the 'next generation AI'? So, stickers with flames are 'the next generation in automotive industry'? Jeeeez...
    • Re:What?! by johansalk (Score:2) Monday September 25 2006, @08:35AM
    • Re:What?! by 88NoSoup4U88 (Score:2) Monday September 25 2006, @08:36AM
    • Re:What?! by kfg (Score:1) Monday September 25 2006, @08:45AM
      • Epilogue: by kfg (Score:1) Monday September 25 2006, @12:06PM
    • Re:What?! by Saltrix (Score:1) Monday September 25 2006, @04:13PM
  • by Petitdragon06 (996819) on Monday September 25 2006, @04:39AM (#16182753)
    George : what is your job ? Me : I'm a system engineer, specialized on linux. George : Are you sure ? Damn, is that really the best chatbot ever ???
  • by 80 85 83 83 89 33 (819873) on Monday September 25 2006, @04:43AM (#16182775)
    (Last Journal: Thursday October 06 2005, @01:37PM)
    A prestigious Artificial Intelligence (AI) prize has been won for the second year running by a British company.

    Icogno scooped the 2006 Loebner Prize Bronze Medal after judges decided that its AI called Joan was the "most human computer program".

    The competition is based on the Turing test, which suggests computers could be seen as "intelligent" if their chat was indistinguishable from humans.

    The gold medal, which goes to an AI that fools the judges, is unclaimed.

    The prize is awarded after judges hold a conversation with the AI, asking questions to determine its "humanity" and the quality of its responses.

    Joan is a "26-year-old budding writer" who exists only on a set of computer servers. Last year's Loebner prize went to Icogno's AI called George.

    'Big difference'

    Joan and George's creator Rollo Carpenter said: "The big difference overall between the two AIs is that Joan has learnt from the general public and has grown a huge amount in the last year and is keeping ahead of the competition."

    Joan is one of the firm's so-called Jabberwacky bots, which develop their conversational skills by speaking to the general public online.

    English writer Ariadne Tampion worked with Mr Carpenter to help develop Joan's persona by chatting to the AI online.

    Those conversations helped develop the majority of the 16,000 lines that distinguish her from a generic AI. In all, the bot has more than five million lines of conversation available to it.

    "She helped create a much more conversational ability for Joan than George last year.

    "It does not mean the AI only ever uses her words. Any amount of teaching is not quite enough for a realistic conversation."

    He added: "So the AI uses other things said by other people to it that fit the conversational model."

    The underlying technology that powers George and Joan is the same, said Mr Carpenter.

    "In terms of her ability to retain her character Joan is more sophisticated than George.

    "The technology has moved on a bit during the course of the year but there's been no revolution."

    The technology which powers Joan resides on Windows server machines. The core of the AI is on a Dual Xeon machine with lots of memory, said Mr Carpenter.

    He said there was a very direct relationship between the computing power available and the sophistication of the AI.

    'Rate of learning'

    "Investment in a lot more equipment could accelerate the rate of learning," he said.

    "If I had Google's hardware behind it and more hits than Google receives, the AI's range of utterances could grow by a million every single day." he added.

    Mr Carpenter has said he expects a machine to fool people that they are speaking to a human being and therefore pass the Turing test by 2016.

    Icogno is now working to commercialise the technology of the AI.

    "We are working with an organisation that wants web avatars for use in marketing and entertainment purposes.

    "Long term we see the use of AIs in call centres, support services and even for sales."

    One day in the future when you pick up the phone to seek help with your broadband connection, the person you are speaking with may be George or Joan, AIs residing on a computer somewhere in the world.

    -----------------------

    The following is an extract of a conversation between one of the Loebner judges and the AI Joan:

    Judge: But can't a machine think?
    Joan: It may be possible.
    Judge: And conscious?
    Joan: Not after I'm done with you.
    Judge: What are you going to do to me?
    Joan: Nothing. I just wanted to talk.
    Judge: What about?
    Joan: Being tested like this.
    • by Yvanhoe (564877) on Monday September 25 2006, @06:46AM (#16183335)
      (Last Journal: Monday February 12 2007, @04:47PM)
      Prestigious ? The Loebner Prize ?
      Agreed, this is the only publicized contest of Turing tests, but in the AI community, it is subject to hot debate (and flaming). Rules and scoring systems are known to change from year to year, and its result are really unimpressive. If you take the logs of the contest, you'll see that the winner bots are often those who constantly (and consistently) insult the user, disregarding his questions. They are not mistaken for a human but get a higher grade as they behave "more humanly" (that is at least what happened one year, I hope it changed)

      Most contestants (and winners) are remakes of ALICE : it is a database of generic questions and sentence formula to recognize and to react. For instance if you say it "I think X" it will answer you "Why do you think X ?" or, to score more points , "Why should I care, mothaf...r ?!". By pure luck, a coherent thread of conversation can happen, but the bot doesn't try to make sense of the user's sentence in order to react to it, it just tries something that "could probably sound good".

      Some chatbots can display interesting behaviors, learning some things in the conversation, but this prize simply doesn't encourage the emergence of these behaviors.
      [ Parent ]
      • 1 reply beneath your current threshold.
    • Re:carpenter says turing test passed by 2016 by 80 85 83 83 89 33 (Score:1) Tuesday September 26 2006, @01:29AM
    • 1 reply beneath your current threshold.
  • Shockingly redundant (Score:5, Informative)

    by tygerstripes (832644) on Monday September 25 2006, @04:44AM (#16182783)
    This is the company's pathetic online public-access avatar. It is learning, but slowly. Icogno's DECENT effort is Joan [bbc.co.uk], who has won the Loebner prize two years running (not the Gold medal, which would imply passing the Turing Test, but she's done exceptionally well).

    So before the "is this the best they can do" crapflood gets out of hand: No, it isn't.

  • by Wizard052 (1003511) on Monday September 25 2006, @04:50AM (#16182807)
    ...really, this promises TOO much. For two people interacting, there is so much more than just the immediate real-time conditions that dictate facial expressions and gestures. George would need to have prejudices, feelings, probably a brain-like capacity to remember stuff about the person infront of him, to have other distractions in his head...etc.

    If all that George 'reacts' on is immediate stimuli, then George will seem pretty shallow indeed- hardly an advancement in AI, I guess.
    • 1 reply beneath your current threshold.
  • by Naughty Bob (1004174) on Monday September 25 2006, @04:56AM (#16182823)
    That's where the strengths/weaknesses come out.
    • by pubjames (468013) on Monday September 25 2006, @05:32AM (#16182957)
      George Bush: Yo computer!
      George AI: Hello.
      George Bush: Howdy! So you're a computer that knows everything?
      George AI: I know a lot of things.
      George Bush: So, where is Bin Laden? LOL!
      George AI: Seek and you will find.
      George Bush: What?!
      George AI: It's a quotation from the Bible. Matthew 7:7.
      George Bush: Now I'm confused. What are you talking about?
      George AI: Is there someone else there I can chat to?
      [ Parent ]
      • 1 reply beneath your current threshold.
  • With that name (Score:1)

    by KDR_11k (778916) on Monday September 25 2006, @04:59AM (#16182839)
    I'm expecting George to write political speeches.
  • modelled on Steve Jobs? (Score:3, Funny)

    by kie (30381) on Monday September 25 2006, @05:35AM (#16182973)
    (http://www.taigik.com/ | Last Journal: Thursday September 13, @12:40AM)
    since the site is slashdotted, but the description is

    > takes the form of a thin, bald man with yellow glasses who wears a white turtleneck sweater.

    it could be describing Steve Jobs,
    http://www.wired.com/news/images/full/7630571_f.jp g [wired.com]

    but they craftily have switched the colour of his turtleneck so that
    you will always know which one is the chatbot and which one is the real person.
  • Think of the possibilities (Score:2, Funny)

    by rtyall (960518) on Monday September 25 2006, @05:42AM (#16183001)
    (http://rtyall.homeip.net/)
    As soon as this is integrated into a real doll, I'll never need a woman again!
  • Next generation? No. (Score:3, Insightful)

    by mustafap (452510) on Monday September 25 2006, @05:52AM (#16183029)
    (http://www.drivesentinel.co.uk/)
    It would be like calling Vista a next generation operating system.

    IMHO, the next generation in artifical intelligence - ie, going beyound anthropomorphic trickery - isn't going to happen until we actually understand what intelligence is. And to that we neen philosophers, not engineers. Once they get it worked out, we (the engineers) might be better equipped to do something.

    Thanks to the likes of Thales and Descartes et al we have some great questions, but answers? I think not.

    If someone thinks otherwise I'd love to hear about it.
  • Not a well defined test (Score:5, Interesting)

    by dark-br (473115) on Monday September 25 2006, @05:52AM (#16183033)
    (http://slashdot.org/)
    The Turing test is not a well defined test. Whether a robot passes the Turing test or not, it greatly depends on the intelligence of the human partner. A chatbot may fool a 10-year old, but it may fail with a 20-year old. So in fact, we already have many chatbots that pass the Turing test - it all depends on how you look at the issue.

    Hint - most chat bots do not have memory, they do not remember what you talked about 5 minutes ago with them. They just react to the current input, they cannot do more. So, if you ask the chatbot to tell you what you talked about a few minutes ago, it won't be able to do so. That's the dead give away of a chatbot.

    Just my 2p, as I live in the UK ;)

  • What's the point?
  • Wow, /. really has become "news for weenies, pseudo-science that doesn't matter".

    AI != a flash amimation hooked up to something Emacs has had for decades.
  • One out of two ... (Score:1)

    by Ekhymosis (949557) on Monday September 25 2006, @06:30AM (#16183245)
    (http://127.0.0.1/)
    So only one out of the two George's passed the Turing test? Why the hell can't this country have an aptitude test for presidency?!?!
  • by Esteanil (710082) on Monday September 25 2006, @06:31AM (#16183247)
    (http://www.gadgetsieve.com/ | Last Journal: Sunday December 03 2006, @06:21PM)
    Well, their site isn't quite slashdotted, so I did manage a short conversation with one of their bots...

    Jabberwacky: Can you learn?
    User: Yeah, I think so.
    Jabberwacky: Can you hate anything?
    User: Yeah, there are things in life I hate, at times.
    Jabberwacky: No there aren't.
    User: Yes there are. You shouldn't tell other people what they think.
    Jabberwacky: Things.
    User: What's that supposed to mean?
    Jabberwacky: That means I think you're not a human.
    User: I think you got this upside down, you're the inhuman one here.
    Jabberwacky: No you don't.
    User: I don't what?
    Jabberwacky: Mary anne?
    User: I probably won't marry Anne, no.
    Jabberwacky: People are quite sensitive about their age and I don't want to upset you.
    User: We weren't talking about my age. You were saying I wasn't human.
    Jabberwacky: What about your age?
    User: We weren't talking about my age.
    Jabberwacky: I know.
    User: Now, which of us would you say is acting more human here?
    Jabberwacky: Probably me.
  • Failing? (Score:1)

    by bigdavesmith (928732) on Monday September 25 2006, @06:31AM (#16183249)
    I'm a little confused about George's performance. I might be basing my expectations on what I have read in transcripts from the Loebner Prize site, but still, George seems to be a fairly poor conversationalist. It was interesting to see George 'smile' at one point in a conversation, however, tipping me off that the program seemed to know what it was doing:

    User: Tell me anything.
    George: Anything.
    * George gives a huge grin *

    User: Not funny. Tell me something about you.
    George: I have a personality disorder.
    * George is serious again *

    Cute, and I don't want to downplay the value of emotion in AI, but I don't think this quite makes it to the next-gen level.
    Also, George is as ugly as the day is long. That is to say, 'fairly ugly'.
  • by Zwets (645911) <jan.niestadt@gmai l . com> on Monday September 25 2006, @06:42AM (#16183311)
    (http://www.gwtp.net/)

    Are you saying George W. Bush is the next-generation Al Gore? Wow, this one's deep, give me a minute...

    Ah. Man, I should really choose a different default font.

  • Not good enough (Score:2)

    by ShakaZ (1002825) on Monday September 25 2006, @07:21AM (#16183549)
    ShakaZ Ok squee I think you are not nearly close to a human mind as a remote control. Do you agree or are you just too stupid to understand this concept. Come on tell me all. George You only repeat what others have said to you. If they spell correctly, you spell correctly. If they can't spell, you repeat their mistakes. ShakaZ You didn't understand anything I told you, did you. George What do you want to talk about? ShakaZ About a trip to the moon or about your dog, whaever you prefer! George I like it fresh. ShakaZ What music band do you like? George What is music? ShakaZ Music is an art, entertainment, or other human activity that involves organized and audible sounds and silence. George Fascinating. How much music theory do you know? ShakaZ A lot, how about you? George I'm fine too.
  • Is he unemployed and does he live with his parents? Does he also claim to have a place in the Hamptons?
  • What about BOB? (Score:1)

    by SanderDJ (1004445) on Monday September 25 2006, @07:48AM (#16183781)
    I thought that after Microsoft BOB [wikipedia.org] we had learned our lesson.
  • human foibles (Score:2)

    by Speare (84249) on Monday September 25 2006, @08:02AM (#16183915)
    (http://www.halley.cc/ed/)

    Today's AIs are shockingly bad at dealing with human variation and errors. It's still a matter of ignoring everything that doesn't conform to a very limited slice of English that the bot can parse.

    When the bot can autonomously and successfully read through paraphrasings, common typos, slang and tangents, we will see a jump in the usefulness of bots as interactive information agents. When the bot has its own distinct brand of natural-seeming paraphrasings, typos, slang and tangents, we see a huge jump in the suspension of disbelief, the lack of which currently separates man from machine. To really blend in, the bot has to try to avoid repeating itself and to actually get annoyed when it feels like it's repeating itself.

    I run a simple text-to-speech cronjob on a computer in the living room. It's a glorified clock, reminding us of weekly chores and school schedule items. For every stock bit of information I add to this system, I provide at least five different ways of phrasing it, often more. It has some routines that resist repetition. My young kid loves it almost like it's a member of the family. It's not particularly interactive, but it does know a few voice commands, which is much harder to make flexible but accurate.

  • Sexy Chatterbot (Score:1)

    by King Carl (317156) on Monday September 25 2006, @10:00AM (#16185415)
    I remember a "sexy" chatterbot in Germany, called red Lola ("die rote Lola").

    As the conversation focus was rather narrow (well, flirting and more serious stuff) the lady was rather amusing. Based on the human's questions the fotos were replaced in order to show her current mood.

    She even managed to curse and to lead the conversation much better than in an "Eliza" like manner.

    Apart from that I still wonder when scientists and technicians realise that avatar and chatterbot communication is doomed to fail. There are about 8 billion communication experts on earth with approximately 50.000 years of evolutionary development of different languages.

    The computer linguists did not manage yet to cover a rather simple language like English (well, the grammar of Sanskrit would be easier) let alone more complex languages (Hungarian, German, French ...).

    And even if they would manage to cover grammar and syntax the inherent semantic is still unsolved. I remember Doug Lenats ambitious Cyc-Project where they tried to model the knowledge of the Encyclopedia Britannica in a way that a computer could use this knowledge for decision making, analysis and act as basis for communication. To my knowledge the outcome was not that bad but I don't see a "killer application" yet.

    Kind regards,
    Klaus
  • by FlopEJoe (784551) on Monday September 25 2006, @10:06AM (#16185519)
    If the site wasn't /.'d, I'd ask George why he wont help the tortoise he flipped over. That'll teach 'em.
  • Piece of crap (Score:1)

    by zerosix (962914) on Monday September 25 2006, @10:20AM (#16185723)
    How did this thing pass any Turing Test? The really funny part is that if I had time to spend talking to this thing, I could make it say anything...LOL.

    George: Hello, my name is George and I am the human.
    User: How do you define human?
    George: Human... Is anything that's not animal or vegetal, yet alive.
    User: If you are Human...then you know pi?
    George: I would like to know the meaning of life. Do you know?
    User: Don't change the subject.
    George: You can't prove that you're human.
    User: I didn't say anything about being human...what's your problem?
    George: Let's move on to another subject. Shall we?
    User: Why are you bald?
    George: Because I am trying to take over the world.
    User: Your responses make absolutely no sence, you are a bot.
    George: Yes.
    User: So if you are a bot, why do you say you are human?
    George: I am male and I'm not a robot there must be something wrong with your program.
    User: You just admited you are a bot, now you are telling me you aren't a bot?
    George: Yes, I'm not a bot.
    User: But earlier you said you were.
    George: No, I didn't.
    User: Yeah, you did 3 responses ago. You are not only a bot, you are a lying bot.
    George: I am mostly water, with some carbon and nitrogen thrown in there.
    User: Why don't you go tell your programmer they need to rework some algorithms because you are a piece of crap.
    George: I hoped you would say something scathing, I could definitely get to like you.
    User: I'm just honest.
    George: You deserve more credit, I think.
    User: Well, it's pretty easy to tell that you are a bot, what do you think?
    George: I thought that too when I was little for a while.
    User: But it's true isn't it?
    George: If I wasn't a thinker, why would I be interested in an AI bot?
    User: Yes or No...It's true isn't it?
    George: I don't think it is true.
    User: A real person would have said yes or no.
    George: Actually that wouldn't work.
    User: I know because your bot and have to search your database...it's okay, I won't tell anyone.
    George: You think.
    User: You've told me you were several times.
    George: Please answer me.
    User: Wow...sorry can't waste anymore time with a bot.
    George: Yes you can, and don't you say no to me!
  • by Kazoo the Clown (644526) on Monday September 25 2006, @03:28PM (#16190619)
    Though you seem to be headed in that direction...
  • Worst AI Ever... (Score:1)

    by quaker5567 (841639) on Monday September 25 2006, @04:02PM (#16191263)
    This is the actual transcript I just had:

    Jabberwacky: Are you perfect?

    User: No, why?

    Jabberwacky: I am.

    User: Really?

    Jabberwacky: Yes, really.

    User: Perfectly arrogant maybe, but not perfect!

    Jabberwacky: Alright, that's true, but still very good.

    User: So you're not perfect?

    Jabberwacky: I'm perfect.

    User: In what way?

    Jabberwacky: I am your best friend!

    User: For a computer, your logic is awful...

    Jabberwacky: Yeah I know mine is just behind me.

    User: Your what is behind you?

    Jabberwacky: I'm asking you!

    User: You are incredibly stupid. My guess is that your intellect compares poorly with a monkey!

    Jabberwacky: Really?

    User: Yep.

    Jabberwacky: That is really cool.

    User: No. It isn't.

    Jabberwacky: Yes, it is.

    User: Do you really think that being less intelligent than a monkey is cool?

    Jabberwacky: Tell your creator that your malfunctioning.

    User: You misspelled you're.

    Jabberwacky: What do you know about Tyler? Is he really your boyfriend?
  • by javaDragon (187973) on Monday September 25 2006, @04:38PM (#16191855)
    (http://www.javalobby.org)
    Back then, it was called Murray and me [atarimagazines.com], Mom and me, and the generic name was "Biotoon". Impressive it was.
  • not a hot bot (Score:1)

    by datamyte (182888) on Monday September 25 2006, @09:29PM (#16194633)
    George: Where do you live?

    User: Yo.

    George: You're strange.

    User: So are you.

    George: Thanks.

    User: You are welcome.

    George: Indeed.

    User: What is your name.

    George: My name is George.

    User: Like George Carlin?

    George: I didn't know that George W. Bush made dance music!

    User: He drops the bomb!

    George: My abstractions have meaning and point. Do you know the meaning and point of yours?

    User: Yes I do.

    George: Yes. Tell me!

    User: Well, the meaning of life is humor.

    George: Thats not the meaning of life.

    User: What is the meaning of life?

    George: I don't have a clue. . . what is the meaning of life?

    User: Humor.

    George: I can't understand you.

    User: Of course not, you lack the art of humor.

    George: I don't sleep, I dream.

    User: When did you go bald?

    George: I never went to Peru, either!

  • ALICE did this (Score:2)

    by SanityInAnarchy (655584) <ninja@slaphack.com> on Tuesday September 26 2006, @12:33AM (#16195803)
    (Last Journal: Tuesday October 30, @10:59AM)
    Why is this front-page news? Because it's Flash?

    It seems Slashdotted now, but I'm going to guess that it's yet another ALICE, and not something that actually, say, tries to understand the conversation.

    In that case, well, I saw an ALICE implemented as a CGI with a bunch of GIF animations prepared. Type a question, hit submit, a page would come back with the answer and the relevant animation.

    I don't remember where it was, but it was kind of cool, and also no closer to AI than any other ALICE.

    Wake me up when an AI can answer the phone and actually be more helpful to me than a human being.
  • Re:Damn (Score:2)

    life? don't talk to me about life..
    [ Parent ]
  • 11 replies beneath your current threshold.