The cable is only an issue because someone decided to turn VR into the Wii and the rest of the idiots in the industry followed suit.
That is an incredibly dumb assessment precisely because you completely failed to address the problem of the cable. The number of people who have accidentally ripped their headsets from the head due to the cable is near enough to 100%. A very very significant portion of people have damaged their cable or their headset, often beyond repair. The defining failure mode of the Rift CV1 wasn't the headset, but the fact that no replacement cables are available. Heck one of my friends ruined his motherboard thanks to yanking the cable with his arm mid game and reefing the USB port straight off the PCB. I ruined one cable just sitting on my arse when it was run over by the wheels of my chair one too many times.
The people who strived to eliminate the cable are the opposite of idiots. They addressed a very real problem. I loved my original Oculus Rift. I loved my Rift S, but wholly fucking shit did a whole world of usability open when that god fucking awful experience of being tethered and tangled was eliminated. And I played most of my games sitting on my arse.
But they bother most people
You are not most people, and clearly you've never met or conversed with most people. Get out, spend a bit of time on VR dedicated forums, or even just reddit. You'll find your opinion is in the strong minority. Side by side latency comparison is useless. The question is does it work for the use case or does it not. The existence of 144Hz+ gaming monitors doesn't mean that most people are perfectly fine gaming at 60Hz (in fact the majority of people are).
which is why VR couldn't break into the mainstream.
Latency has zero to do with why VR "couldn't break into the mainstream". At least not since Oculus resolved the motion sickness issue caused by latency back in 2013. By the way VR headsets have well and truly outsold the Nintendo 64. So if you don't consider that mainstream it's worth noting you also didn't consider a ground breaking and highly successful and popular gaming console mainstream either. I really question either your knowledge of the industry, or your disingenuous use of the term "mainstream".