This is inevitable.
You need to continually track people's localized movements to reduce the total search space while obtaining multiple images of each person while they move; merging multiple images to get higher resolution images, over time (wind, rain, lipstic, changed hat, etc) all affect confidence, and then eventually match that to a known database of people.
Eventually, correlating time to location, credit card purchases, and cell phone, you'll have a perfect match. Your phone linked to email addresses will link your online identity and bam you get a full picture.
Of course, everyone who is not matched by this is a suspicious character since you're not in the database. Even sudden changes in appearance would signal suspicous behavior... why did you just put on a wig. Biggest trouble this database will have will be girls going to hair salons.
As someone from the US, you should eventually be in the database from birth. Anyone new, travelling from overseas will be suspicious. That doesnt mean its local to the US. With credit card databases, a few outsourced security firms and security cams globally monitored, you'll be tracked everywhere.
Who you meet for coffee, etc. Actually, that is the objective. Find who you meet for coffee.
Its going to happen because I can think about how to do this, so its possible.