I agree with you on that count, but the paleo diet is still flawed in that its fundamental premise - that at some point in the past mankind was somehow in sync with their environment, and their diet at that point was perfectly aligned with their nutritional needs.
This is apparently because our ancestors evolved to a stable state on one diet over a very long period of time.
This is a massive, and wrong, assumption. Humans were never in perfect harmony with their environment, even if such a condition is at all possible.