The medievel mob were roaming the streets looking for jews. Because those jews were a "hostile elite". Given such jobs as tax collectors because they had to scruples or sympathies. Allowed to be usurers in exchange for bribes to the throne. And other unsavory activities like human sacrifices aka "witchcraft" and the like. So yea. Occasionally those "mobs" would be a little upset with the tiny hat wearing merchants.