Exactly, I've always thought that Calculus, Trig, and Statistics should be taught in high school with computers only. No paper, pencil, and NO math notation. Learn how to use it to solve problems and get the concepts down. Plenty of time to learn the theory and notation in college when you've had a couple years of doing tasks on a computer. Teachers spend so much time teaching the notation regurgitating the theory that has no basis in how it's actually used that it's no wonder so many teens get turned off to higher math and consequently programming. Saying "well, not everyone is cutout for math or programming" is a cop-out. Like saying not everyone is cutout for reading or writing.
If I was king, programming would be taught every year from the first grade just like writing.