If it makes you feel better, I had to escape that wonderful-smelling coffee shop due to some loudmouthed customers. It's like, why do some people feel the need to talk as loud as humanly possible? Since I can't tell them to STFU, I just left.
Are you sort of a regular? I used to go to a certain café on (more or less) a daily basis, to have a coffee and read a newspaper - I definitely remember the loud people who came there occasionally... very annoying!
Here: Freshly brewed coffee, tobacco smoke and aftershave.