Re:Sweet! (Score 1)

According to the privacy settings help page, you can do just that:
http://www.google.com/support/mobile/bin/answer.py?answer=136650

Set your location. Manually select a location on the map that will be shared with friends

Doesn't look like you can do that per-contact though.