Oh, I agree. Sometimes corrections work out well enough for the engineers to make fancy new things. Physics doesn't have to be right. It only has to be right enough.
As to neutrinos and antimatter and all that subatomic mess. Once it was simple: Bohr atoms and neutrons, protons, electrons, and photons. Then the physicists had to start adding corrective wavicles, like neutrinos, then quarks, then multiple different types of quarks, etc, etc. Now we've got this huge particle accelerator to find even smaller, more powerful, and shorter-lived whatevers to glue everything together. Modern physics is the physics of the absurd.
What is bound to happen is that somebody playing with esoteric maths of fractals or set theory or topology or something else out of left field is going to discover something really simple, like a way to look at things where every quark, every star, every galaxy, and every other part of the physical universe is simply the way the entire universe expresses itself in that particular context. And while the physicists of that day are arguing over how that can be reconciled with classical physics and string theory, some engineer somewhere will look at it and say "ah-hah!" and build a network of star gates. And that engineer will unwittingly midwife an entirely new physics.
But getting back to your point, it is very much important to recognize that something is probably wrong even though it works well enough for the purposes at hand. Otherwise you are accepting some basic premises on blind faith, and that kind of religious belief is indeed blinding one to other possibilities.