The vast majority of people can actively enjoy music in the background *and* pay attention to what they're doing -- it doesn't become "white noise" just because we're not focusing all of our attention on it. Music also actually helps us enter the 'zen' state that results in markedly improved performance; at that point, we'll be focused on the task, but fall right back out of the zen state if someone shuts the music off. That's why music is commonly found playing in situations that require a great deal of concentration: performing surgery, playing a tough video game, writing fiction, etc.
For me it is the exact opposite, and I'm coming to accept I'm in the minority. If I need to concentrate (e.g. soldering, writing code, or doing math), I need silence. Even when I worked as a bike mechanic, I had to exact compromise on the radio volume from my coworkers*.
*The only way I could explain it was that it "grabs my brain" or "pushes things out of my brain". Say I'm working on a bike: I notice something I must check next, after I'm done what I'm doing. Then I notice something else that must be checked, but any time later. (I'll jot the 2nd one down when I get the chance, but right now I can't let go of what I'm in the middle of.) Now I realize I need to choose a more appropriate tool for what I'm doing right now (notice my stack is now 3 deep), so I turn to the workbench, just as the radio blares out the even more annoying part of that song or a sponsor starts yelling about used cars, and - BLAM, I've lost one of those 3 items. I have to go back physically and mentally to the same point and quickly rerun things to try and get it back. In short, it breaks the continuity or "flow" and I'm less efficient. (And more "on edge" too, as I try to tune it out.)
I know it also reduces my skills of observation - e.g. when doing something mechanical, noticing defects or that a manual process didn't go as properly as it should have.
And forget about doing anything clerical - most music (or esp. annoying commercial radio) "pushes numbers out of my brain" that you need to keep a hold of for several seconds at a time.
At another workplace, a colleague in the next cubicle was working on ACAD drawings - while rocking his head to something heavy metal-like. I just can't get that. Meanwhile, I'm working on some technical document, and had to ask him to turn it down.
Aside from the volume, in general it may be that music with vocals is worse for this effect.