I don't know about women, but it certainly kept me out of theoretical physics. It also delayed my entry into the computer industry by about a decade.
As a student I loved cosmology and particle physics. Then I met the guys who were working on their PhD's. I was good at doing math. They spoke math. It was clear that they were in a different category from me, and even though I might be able to do it with hard work, I would never be one of them. At the time you had to be a math major to get a degree with a concentration in computer science. Again, I met folks who were real math majors. They also spoke math as easily as John Coltrane spoke music. I knew I could never compete in their world. So I didn't.
As it turns out, my friends in comp sci were right to encourage me to join them. Just because I was never going to be the next Alan Turing doesn't mean I couldn't have been doing good work.
Anyway, there is definitely something to the notion that certain fields appear to require a certain type of brilliance. Music. Athletics. Field theory. Topology... Fields like these all appear to require special gifts. LeBron James and Tiger Woods have abilities that 99% of us just don't have. The same goes for Eddie Vedder and John Lennon. Or Alan Guth. But that doesn't mean that you can't participate in athletics if you aren't Michael Jordan. There are gym coaches and trainers all over the place making a living in athletics. There used to be music teachers at all the elementary schools. And there are loads of people working in applied mathematics crunching numbers for companies and governments for various purposes, doing perfectly good work in a field they love without being a 1% talent.
But I certainly didn't believe that when I was 19 and trying to decide where to dedicate my life's work. So I agree with that part of the premise. What in the world that has to do with gender, I don't know.