Submission + - Yale "Freakonomics" professor: Bing is not preferred 2:1 as Microsoft claims (freakonomics.com)
UnknowingFool writes: In 2009, Microsoft launched a national TV and print advertising campaign for Bing claiming that their study showed that it was preferred 2 to 1 over Google in search results in a head-to-head challenge reminiscent of the Pepsi challenges from the 1980s. MS then invited consumers to take their own test at www.bingiton.com.
Yale law professor Ian Ayres (of Freakonomics fame) and his law students published a paper On their study that found that Google was preferred over Bing 53% to 41% with 6% ties. This was far from the 2:1 ratio MS claimed. Professor Ayres matched the small sample size (1000 people). Although the commercials gives the impression that the results of the MS was a head-to-head street challenge, the results came from a online study MS commissioned through Answer Research.
Noted differences between the two studies was that the Yale study randomly assigned the user one of three different sets of searches: 1) Bing supplied searches, 2) top 25 web searches, or 3) user defined searches. One Bing searches the results were almost the same but users preferred Google in the other two sets. Another main difference is that MS has not published the methodology used or tracked individual user responses.
Legally, one conclusion of the study was that Google might have a deceptive advertising suit against Microsoft.
Yale law professor Ian Ayres (of Freakonomics fame) and his law students published a paper On their study that found that Google was preferred over Bing 53% to 41% with 6% ties. This was far from the 2:1 ratio MS claimed. Professor Ayres matched the small sample size (1000 people). Although the commercials gives the impression that the results of the MS was a head-to-head street challenge, the results came from a online study MS commissioned through Answer Research.
Noted differences between the two studies was that the Yale study randomly assigned the user one of three different sets of searches: 1) Bing supplied searches, 2) top 25 web searches, or 3) user defined searches. One Bing searches the results were almost the same but users preferred Google in the other two sets. Another main difference is that MS has not published the methodology used or tracked individual user responses.
Legally, one conclusion of the study was that Google might have a deceptive advertising suit against Microsoft.