There's two annoying things about it. The first is how it's forced into our lexicon, that's annoying enough. But almost equally annoying is the nonsense behind its etymology. "Semitic" is a language family applying to a broad range of historic peoples, including some historical jews, but mostly it's an antiquated word used by historians to describe a group that barely had anything in common. In the sense of the meaning of the words, it's almost impossible to be truly "anti-semitic" because how do you hate an ancient language family tree? That just really grinds my gears, "anti-jew" would've served their purposes just fine but they have to corrupt language by using words to mean things completely unrelated to their dictionary meaning.