The little amount of maths that's in there is not that difficult to understand.

What? Holy shit, what books are you talking about? Definitely not TAOCP. The first half of Volume 1 is all math - specifically discrete math: the kind that's relevant to analysis of computer algorithms, but that's not studied in much detail outside of computer science. I have a master's degree in CS and consider myself pretty competent when it comes to, say, calculus, but I got lost in some of the sections on harmonic series and generating functions.

Volume 2 is _all_ math and again, not trivial math. There's 30 pages of theoretical discussion on what makes an infinite sequence random. The introduction to chapter 4 talks about number representation in base -10. There's a _LOT_ of math, and it's very difficult to understand (but it is fun to do so).