If they check 1 line of code every second it would take 133,101.85 years to check 11.5 billion lines of code. At 1000 lines of code every second you are looking at 133.10 years to check that much code. At 4000 lines of code every second (e.g. 4GHz) you are looking at 33.2 years to check that much code.
A: We know they didn't check the code by hand.
B: The methodology didn't classify defects (cosmetic, seucrity, minor, major. etc.)
C: The numbers aren't normalized nor broken by application size.
D: The use of a bug reporting database needs to be measured in regards to a baseline filing\fix % not a total volume (as we need to correlate new lines of code being added)
I'll only say this. Their methodology is not very good and thus any outcome they draw from is only as vaid as their methodology...
A 1% defect rate in an application, say the size of the Linux Kernel is a very different animal then say a 1% defect rate in say, VIM. In addition, 44 minor defects is very different then 6 majors. A minor defect could be as trival as a field not being aligned properly on a form.
You need to see a comparison such that:
App A
23 Minor
14 Major
3 Critical
and the accompaning resolution rates for the MMCs.
Usually it's
Minor : 95%
Major : 99%
Critical : 100%
Volume of defects is proportional to complexity, not lines of code.
That's like crying there is an epidemic of 5000 people dead every year... With a population of billions that is not even in the area of insignificant. 5000 people dead in a since town... that is a serious problem when the population is only 65000... SCOPE counts in data analysis.
This is garbage reporting... I don't care about the outcome, I don't agree or disagree but the methdology I see so far... I would fail this as an assignment in high school... If you are going to publish news about a report, part of the reporting is to indicate the methodology...
It reads like something from the Onion. "Gartner reported today that Gumby is more popular then Spongbob by using a computer!"
At the very least you need to throw in "Gartner reported today that Gumby is more popular then Spongebob by using a computer model that took people between the ages of 50 and 89 and had them fillout a survey. After normalizing the data and eliminating outliers Gartner consultants were able to determine that Gumby was more recognizable then Spongbob by a margin of over 90%."
Dear Lord journalism is dead...