There used to be a science of it and it was called physiognomy. It had to be shut down because all of the 'bad' characteristics just made people look like jews and Africans.