There are two problems:
First is that the vast majority of our spending is on social programs and the military. The Democrats (generally) want to cut military spending and increase social spending. The Republicans (generally) want to cut social spending and increase military spending. Neither of them wants to actually spend on infrastructure unless there is a direct intersection with their primary objectives. Most of our national infrastructure that wasn't built by private parties is a result of those intersections (i.e. PWA in the 1930s trying to spend our way out of the Great Depression, or WW2/Cold War era military spending). They'll talk a good game at election time, or during a State of the Union speech, but when the time comes to allocate funds, it rarely seems to happen unless one of the intersections above is in play, or something just exploded and the politicians are afraid of looking like it's their fault. I don't expect this to change meaningfully in my lifetime.
Second is that we can't do anything as a society anymore because we're a culture of blaming (so we're incredibly risk averse). The lawyers and insurance people run the show on all major projects, and things cost much more, and take much longer to build (and the longer build times make things cost even more). The Empire State Building took 13 1/2 months to build. 1WTC took about eight years, which is two years longer than the first transcontinental railroad (which went through two mountain ranges with nothing more than dynamite and hand tools). I DO expect this one to change meaningfully in my lifetime, though I expect it to get worse instead of better.