Should smoking be banned in public places?

Smoking not only affects the smokers, but all of the people around them. Should it be legal for these smokers to affect our health while tormenting their own?