Does noise really damage your health, and how?

Urban dwellers in Switzerland, as in the rest of the world, suffer from noise: statistically, it's the pollution that people complain about most. But is it real "pollution" with a significant health impact, or just "discomfort"?