Poker Driving Artificial Intelligence Research 212
J-Hawker writes "The Canadian Press has a story about a University of Alberta team that is using Texas Hold-'em to study artificial intelligence. Poker seems to be a much more useful game for this research than chess. From the article: 'Poker has what are currently some of the biggest challenges to (artificial intelligence) systems, and uncertainty is the primary hurdle that we're facing,' said Michael Bowling, adding that the University of Alberta program was able to use its opponents' actions to infer certain things about their hands. 'The same techniques, the same principles that we're developing to build poker systems are the same principles that can be applied to many other problems. The nice thing about chess as a property of the game is what we call perfect information. You look at the board, you know where all the pieces are, you know whose turn it is — you have complete knowledge of the game,' he said. 'But in the real world, knowing everything is just so rare. Everything we do all day long is all about partial information. So poker's much more representative of what the real world's like, and in that sense it becomes a much harder problem.'"
AI doesn't work for Spades! (Score:5, Insightful)
While it may seem logical to use the actions of people playing to determine something about their hands, in reality people do not play logically. My uncle has been playing spades for probably better than 30 years, yet I have yet in my relatively limited 10+ years of playing to determine any rational for how he plays. Basically, he really sucks at spades. No matter how "Intelligent" artifical or otherwise I manage to code a game, it can't reason out the reasoning behind a non-logical person.
Good quote I say somewhere: Artifical intelligence is no match for natural stupidity!
And this holds true for more than card game AI. It will not be too long until AI could reasonably drive around and get from point A to point B safely. But it will be a damn long time before it can do it if it has to share the road with people driving as well!
Re:Straight Forward Evaluation (Score:3, Insightful)
More info than a real player? (Score:4, Insightful)
Also, why ensure that no one computer got lucky? Isn't that the point of playing several thousand hands of limit poker, to eliminate the effect of luck in the study? If it's necessary to normalize all the hands received by the players, then something else is wrong with the study. I'd like to see if the results differed, and how, when the hand repetition is removed.
Re:Straight Forward Evaluation (Score:3, Insightful)
In Euchre, knowing your partner's cards is a *huge* advantage... In poker, knowing the cards on one other player at the table gives you such a minute advantage that it's irrelevant in almost all practical cases.
Sure, if all of the players at the table except for you are sharing their cards, and are not required to conceal it (i.e. they can openly collude in their betting patterns against you), then they have a big advantage. But, that's, again, not very realistic.
Re:If you are really interested... (Score:5, Insightful)
stupid computer (Score:5, Insightful)
Computers aren't good at retaining knowledge and recognizing patterns? That's news to me... this statement is obviously made by someone who doesn't know what he's talking about...
A very strong and useful technique in AI is to create learning algorithms. Some of these, such as reinforcement learning, are actually quite effective. Using something like Monte Carlo methods to give it a randomness factor simulates human learning, and computers don't forget what they are taught. The difficulty with learning isn't that computers can't do it... it's being able to define an effective set of state-action pairs for the computer to learn upon.
I spent time researching natural language processing, sometimes using AI techniques that did exactly what this person claims computers aren't good at: reasoning by analogy. One method involved building a knowledge base which generalized input so that patterns can be found and the grammar could be recovered. The weakness in the system wasn't reasoning by analogy, in fact I'd say computers are much better at that than people. It was rather a lack of a real world model which allowed for a wider array of perception.
The reason this game is difficult is not based on a computer's inability to solve problems, rather that there are so many possibilities that we cannot effectively design algorithms that the can be put to use. This isn't even news, the same has been said about the game of Go for the longest time.
I think a more accurate statement for this person to make would've been: "The overwhelming complexity of poker makes it a difficult game to define in a way for a computer to be able to play effectively."
--
"A man is asked if he is wise or not. He replies that he is otherwise" ~Mao Zedong
Re:Innovation through vices (Score:3, Insightful)
Re:The real questions are... (Score:3, Insightful)
AI as a field is still very hot. The difference is that the goals have changed and the field has fractured into smaller sub-fields. The goal of a truly "human intelligence" doesn't seem feasible in any near term scenario. Fields such as statistical learning theory, natural language processing, computer vision, genetic algorithms, and many more yielded very interesting results.
Re:AI doesn't work for Spades! (Score:4, Insightful)
You are not as unpredictable as you think.
Re:Straight Forward Evaluation (Score:3, Insightful)
Completely untrue; you clearly don't understand the purpose of "odds" and probability. The entire purpose of "computing odds" is to deal with situations where you don't have all the information. If you had all the information, you wouldn't be "computing odds", you'd just know.
It is a simple matter of math to compute odds based on knowing what you have, and not knowing anything else. You can't compute the odds they show you on the TV when they know all the hands on the table, but the human gamblers don't get those odds either.
It isn't a simple matter of math to know what to do with those odds, and that's the problem. Computing the odds is a pretty straightforward task, though.
So, in a nutshell, you're claiming that AI players have special problems because they can't compute odds that the human players can't compute either. If anything, it's easier for bots because they can run 100%-accurate real math in the blink of an eye, where a human will probably be using an approximation.
Re:AI doesn't work for Spades! (Score:3, Insightful)
Your understanding of Artificial Intelligence is about forty years out of date.
Artificial intelligence does not use "logic" as its basic representation and hasn't for a while now. In fact your statement is trivially false; it is easy to write a program based on Markov Chains that will beat the snot out of an average human at Rock-Paper-Scissors, and the worst way to lose to that program will be to randomly/"non-logically" bash on the keyboard. I'm talking "undergrad homework assignment" easy. And even a skilled human will find themselves challenged by the program for quite while until they basically learn how to execute the program in their head and out-guess it.
And Markov Chains are old and no longer considered interesting.