I have nothing against my neighbors wanting a "free," quality, public education for their children, but why should I have to fund it?
(Never mind that my children have already gone through the public school system and are off to college now.)
I thought we understood that governments build infrastructure on the premise that we all benefit in one way or another. Roads, airports, shipping ports, military, etc. Otherwise I could extend your argument to include all those other things and more. I may never drive on the Trans-Alaska highway, fly out of Portland, Maine international airport, but I do believe that by making things better for the people who do use them, we've all receive a benefit. Likewise for me, for the things I use.
And that free public education my children received? If I'd had to pay "the going rate" every year they were in school, I could never have afforded it, so now I'm paying for it in installments through my town or county property tax (or your council tax), and my neighbors will be doing the same, and if not here, where ever I live, or they live. If you look at the big picture it all evens out, more or less.