In theory, globalism does make us "richer" in terms of available resources. But monetarily, it's penny wise pound foolish if that leaves people under or unemployed to purchase said goods and services. We can debate trickle-down or trickle-up economics till the cows come home; in either case it's generally agreed both would inject velocity in the money supply between the consumer and purchaser. The problem we've been facing in the past 16+ years is is neither. We've been facing a trickle-out; our nation has been hemorrhaging wealth.
Long term, under or unemployment causes all sort of undesired side-effects. For one, it breaks people from climbing the rungs of a ladder to achieve career success (personal growth, both occupationally and in people skills). Secondly, it short-changes them in saving for retirement. Id say the biggest problem the West is facing is lack of work ethic. Instead, we've been delegating manual and physical labor to overseas and importing immigrants. This isn't a racist POV, it's a serious problem in that it changes the culture with stark contrasts in values. So far, America has it pretty lucky with people south of the boarder having Christian values (yes, it matters, A LOT!!) with an industrious ethos.
In short, leveraging the human labor pool around the world, and the specialized skillsets is a boon to Mankind. But, it ought to be reasonably paced so that the lower and middle-class don't get short-changed by the upper-class that's all too willing to exploit a disparity in wealth from a lack of job opportunity they've (investments, holding onto IP, barriers to entry, etc) created.