It's not just stopping distance. Energy = mass * velocity squared, so getting hit at 35MPH is twice as energetic as getting hit at 25MPH.
Personally, I don't understand why anyone would speed on a residential street unless they haven't thought about it at all. Car doors can open at any time, people can be backing out of their driveway, and of course, kids and pets can run out into the street at any time. I just sort of assume it's going to happen and give every blind spot a wide berth and/or slow down a bit more than 25MPH.
I am the second fastest vehicle you will see on the highway (because the other guy can have that prize in the form of a ticket) but there are just too many potential hazards on a residential street. Even if you, dear reader, believe that a kid deserves to get hit, by you, for running into the street in front of his house just as much as if he ran into a freeway, an accident still takes up hours of time to resolve, and potentially years in jail for killing a pedestrian, if that happens, and you happened to have been speeding. At best, you're spending lots of money for a good lawyer, and many days at criminal trial, not to mention the wrongful death civil trial that's sure to follow. It's just a shitty risk/reward ratio, in purely selfish terms. Make up that time on the freeway, or by making sure you're not staring at your phone the next time the light turns green, or by learning to merge properly so as not to cause traffic jams.
God, I can't wait for autonomous vehicles to be mandated.