An anonymous reader writes: A short essay on why parallel programming is so hard and on how to fix the problem. Excerpted from Parallel Programming, Math and the Curse of the Algorithm:
Adding more processing cores to a CPU should have been a relatively painless evolution of computer technology but it turned out to be a real pain in the ass, programming wise. Why? To understand the problem, we must go back to the very beginning of the computer age, close to a hundred and fifty years ago, when an Englishman named Charles Babbage
designed the world's first general purpose computer, the analytical engine. Babbage was a mathematician and like most mathematicians of his day, he longed for a time when he would be freed from the tedium of performing long calculation sequences. All he wanted was a reasonably fast calculator that could reliably execute mathematical sequences or algorithms. The idea of using a single fast central processor to emulate the behaviors of multiple small parallel processors was the furthest thing from his mind. Indeed, the very first program written for the analytical engine by Babbage's friend and fellow mathematician, Lady Ada Lovelace
, was a table of instructions meant to calculate the Bernoulli numbers, a sequence of rational numbers. Neither Babbage nor Lady Ada should be faulted for this but current modern computers are still based on Babbage's sequential model. Is it any wonder that the computer industry is having such a hard time making the transition from sequential to parallel computing?