If the address of your door is a "wildly different address", then why isn't that just your actual address?
Wildly different than what?
I live on a corner. My "address" is on one street, but if I walk out the side door I'm on the wrong street from what my address says. And I've seen buildings that are ells, having faces on two streets with addresses that wouldn't logically be contiguous.
How do you fix that? Isn't this a situation where "address" is NOT the same as "location", and AV need to know "location" instead of "address"? Coordinates, right?
How do you fix the "coordinate" problem of having ten different coordinate systems in use just in one place? I'm looking at a GPS app on my phone (where I might get coordinates to tell someone where I am) and I see half a dozen applicable datums. Which one does my phone use when I call 911? I think WGS-84 but don't know for sure. Will people know which one they should use? Were you aware that there is a separate datum for Cape Canaveral?
I know about this problem because I deal with search and rescue, and I've seen the result of telling someone a coordinate for something and they wind up in the wrong place. I've had people tell me that there is a "target" at certain coordinates and there isn't anything there -- but there is when I change the datum on my GPS to what they are using.
It's easy to say "just fix it", but actually fixing it isn't that simple, and it may break other things. (Here's one I really love. I order something online and the vendor tells me that my address doesn't exist. I've lived here for 20 years, I get mail and packages here all the time. Unfortunately, the shipping program he's using has "fixed" my address and it doesn't appear in his database, so my address doesn't exist.)