It's a fair point which, as an on/off smoker, I'm well aware of.
Stop being an idiot.
Personal opinion, don't give a fuck about the health concerns. You want to poison yourself that is up to you. But you do fucking stink. All smokers smell bad. It is sweet that you think otherwise, and I'm happy for you that you don't notice it and live with people that pretend not to (or are just plain used to it). But you do smell, and worst of all you make everyone and everything else around you smell. For that reason alone - forgetting the health concerns or the fact that you make what ever area you occupy look dingy - you fucking deserve to be demonised for it.
For similar reasons, I despise fat people. The snorting and grunting as they waddle about, their sweaty faces, the constant smell of cheap pastry and fried food which wafts around them.