First, while it's true that numerical math is not used in many CS areas, discrete math is. Logic, set operations, and the like are used pervasively in CS. And learning numerical math is a core breadth area that instills mental discipline. Quite frankly, if math is not your strong point, then you should consider moving out of CS.
Are you kidding?
I was in a PhD program in Electrical Engineering at a top-10 university [not trying to start a pissing contest here]. Quite frankly, I had a much better opinion of CS until I started taking a lot of graduate-level CS courses there.
Saying CS people do a lot of math is like saying a bank teller or cashier does math all day.
I found undergrad and graduate CS students alike would go running for the hills as soon as someone said the words 'integral' or 'derivative' . Random processes and statistics were avoided.
Most 'numerically' focused papers/research was focused about speeding up raw calculations (such as matrix multiplication) without any understanding of the application and without any critical examination of the possibility for lowering complexity through close approximation, transforms, etc...
Many papers (especially related to CPU/compiler performance don't even average measurements properly). Even the industry-standard 'SPEC' CPU benchmarks use the wrong type of averaging which leads to incorrect results -- in some cases a faster computer (which completes all benchmarks faster than a slower computer) can have a *worse* score than the slower computer].
Computer architecture and programming are fine things to learn, but they are not enough in themselves. If a person wants to be an architect, they have to know not only about construction but also about design -- art, etc... Likewise, I think too much of CS is focused on either way-to-abstract stuff and/or trade skills without giving students a chance at actually learning something more domain-specific.
Programmers are a dime a dozen. Decent programmers that truly understand what they are implementing (in a specialized field - engineering, sciences, etc) are very rare.