If a human driver, using the same map and their set of eyes, can't get the guy to his front door, what makes him think a car programmed by humans will be any better, especially by humans who have never seen the place you're going to?
When I was in college, and for the first couple of years of grad school, I drove a taxicab. Not a fruity Uber car, but an honest-to-god hack. For part of that time, I drove an actual Checker Marathon, which may have been the finest automobile ever built.
Decades later, I can still find my way around that city (Chicago), to any address and give you the best route. If you dropped me blindfolded anywhere within the Chicago city limits, I could find my way (as long as I was allowed to take the blindfold off after you dropped me). If there are Uber drivers who can't find their ass with both hands, it has nothing to do with maps. Maps? Pshaw. Learn your town and don't rely on the goddamn Google maps for everything. Learn how to navigate by the stars like we did back in my day (only partly kidding).