I wish non-smokers were as considerate of the things I despise that they do.
What things do non-smokers do that you "despise", other than resenting your intrusion on their space?
I'm genuinely curious about what you have in mind, because I can't think of a behavior related to not smoking that invades other people's space in the way that public smoking does. It's a fundamentally intrusive pastime, like being loud or wearing heavy perfume. And in all cases the opposite behavior -- talking quietly, not wearing fragrances, not smoking -- doesn't trespass on other people's space.
Sometimes two forms of behavior really can't coexist. When that's the case, the one that takes up less space, and involves not doing something, should always be considered the standard for public behavior and public spaces (including the workplace). Normative quiet doesn't prevent occasional loudness, but normative loudness makes quiet impossible. If fragrance-free is normal, then perfume is an occasional novelty; if every consumer product is soaked in cheap perfume and masking fragrances, there is no neutral state anymore. And if every bar and office is filled with smoke, then everyone's a smoker whether they want to be or not.
I do have serious reservations about having people sign affidavits and so on -- that's going a bit far -- but I think it's totally appropriate to refuse to hire someone because you think their behavior is unhealthy and likely to be a liability to your company. That's a legitimate basis for discrimination, unlike race, sex, and religion, which we've collectively decided are not.
BTW I say this as someone who doesn't mind the smell of smoke (if it's fresh). But I hate the effect it has on people, the way that smokers make the world their ashtray, and the way their chronic coughing and lung issues make them excellent vectors for things like TB and the flu.