In a record-breaking experiment, IBM researchers used the fourth most powerful supercomputer in the world — a Blue Gene/P system at the Forschungszentrum Julich in Germany — to validate nine terabytes of data (nine million million or a number with 12 zeros) in less than 20 minutes, without compromising accuracy. Ordinarily, using the same system, this would take more than a day. Additionally, the process used just one percent of the energy that would typically be required.
The breakthrough will be presented today at the Society for Industrial and Applied Mathematics conference in Seattle.
"In a world with already one billion transistors per human and growing daily, data is exploding at an unprecedented pace," said Dr. Alessandro Curioni, manager of the Computational Sciences team at IBM Research – Zurich. "Analyzing these vast volumes of continuously accumulating data is a huge computational challenge in numerous applications of science, engineering and business. This breakthrough greatly extends the ability to analyze the quality of large volumes of data at rapid speeds."