If you read one of the original social security cards from the 1950's, it says "not to be used for identification". I guess that changed a long time ago.