The three year lease on my Nissan Leaf is over in a few months. I absolutely adore the car. It's been the best commuter vehicle I've had in all ways but one -- range. This is the biggest complaint of all those I've shown it to, as well. Many of the co-workers and friends who have ridden in my car over the years want one! Then they hear what the range is like and they lose interest.
My daily round trip (+lunch) comes in at just under 50 miles. With the highway speeds in my area (75 and up) and putting slightly better tires on it instead of the no-traction-in-rain stocks that I went through all too quickly, my real-world run-until-empty range is about 65 miles (When new with the super-eco tires and driving 65 on the freeway, I could get closer to 80-85 miles of range). This means that by the time I get home I can go back out to shop and return, and that's about it. I cannot use the Leaf for longer weekend runs, road trips, or even for the once every three weeks that I have to commute from San Jose to San Fran (about 120mi round trip). Therefore I have to have a second gas-powered car.
Being that I work in Silicon Valley, owning one gas car and leasing an electric car alongside is feasible. With how much I save on gas the lease is nearly 75% covered anyway. With my office soon installing chargers at work my range will extend considerably. But for most of my friends having more than one car is out of the question, budgetary-wise, and the limitations of a car that can only go about 65 miles before it has to charge for 5 hours (my usual L2 charge is 4h:40m or so, overnight) are just too restrictive. With L3 chargers being few and far between, and often having a cost associated with their use, they don't help much. So, no EV for them.
When my lease is up I'll probably try to get a Toyota RAV-4 EV. It supposedly has a real-world range of over 110mi - nearly double my Leaf. It's more affordable than the Tesla models, and more important to me, I can fit in it (I'm very tall-torso and short-legged; I simply can't get in the sports-car-low roof line of the Model S, and no Model X's exist that they will let a consumer sit in to see if they fit!). I'm bummed that Nissan hasn't found a way to 2x the range of the Leaf, or I'd gladly stick with that model. The Tesla-drivetrain RAV4 is still more expensive than I like, but it'll fit my EV driving needs far better.
When battery technology increases enough that 150+mi range EVs are Leaf-level affordable _then_ you will see sales take off in the urban areas. Any advancements in fast-rate (L3 or better) charging will help that too. Until then, for all of their benefits and wonderfulness to drive, they'll remain a niche for packed-urban-area dwellers who can afford to have a second, dedicated commute car.