I like what Dara O' Briain has to say about it: "Oh herbal medicine has been around for thousands of years. Indeed it has, and then we tested it all and the stuff that worked became -medicine-. And the rest of it is just a nice bowl of soup and some potpourri. So knock yourselves out."
A lot of what you said is very true - herbal medicine in general is not as systematic or scientific as modern medicine.
However, to make a blanket statement that all herbal medicine is hit-and-miss, voodoo magic, and unscientific is also distorting the truth, and based on ignorance of our past. Science is not the fiefdom of the Greco-Roman system we have been following in the last couple of hundred years. Systematic and scientific study has indeed been followed by many old cultures, albeit not to the level of sophistication that we currently follow. Nonetheless, you cannot just trash it completely.
Look at what Sushruta used to do in India in 800BC for example.
To quote the wikipedia article:
"The Sushruta Samhita contains 184 chapters and description of 1120 illnesses, 700 medicinal plants, a detailed study on Anatomy, 64 preparations from mineral sources and 57 preparations based on animal sources."
Not just medicine, he has written extensively about surgery, especially plastic surgery, and some of his techniques and instruments are still being used today.
He wasn't alone, you can also read about Charaka.
What I am basically trying to say is that the basic principles of science such as logic and experimental proof did not get magically invented a couple of hundred years ago. Most scientists in the old days were let down by a lack of infrastructure and lack of mature manufacturing processes, among other things. They were not let down because their approach was unscientific or unsystematic. Don't trash herbal medicine just because the active chemical ingredient of a herb has not been isolated (because of lack of chemical or process know-how). No system of medicine (even herbal medicine) can withstand the test of time if it was solely based on hit and trial or voodoo/magic, instead of being based on logic and method.
To put it another way, should your great grandchild trash-talk and call you a scientific neanderthal just because you used to eat fruits, vegetables, and meat instead of ingesting (isolated) protein, carb, vitamin, and fibre tablets? Forget isolating nutrients from our food, we haven't even been able to properly bio-engineer the food that we eat. Imagine how barbaric it will feel to a person 500 years from now when they realize that our generation actually needed to slaughter animals for our nutritional intake. They'll probably look at us the way we look at cannibals.