Women were forbidden to create portraits of men in the past, to gaze at a man's face for a long period of time was considered improper; I bet, men were just afraid that, if a woman looks for too long at a man she would start laughing and change her portrait to a caricature. :P

This is from a portraiture class I am taking at work. When the model saw that I was drawing him so grumpy, he tried to keep a lighter, happier expression for the rest of the session, but too late, no favors, grumpy looks funnier in a caricature.

Hutch, if you are reading this, I saw what you did to my portrait of Rick :D, I am still laughing and I want a copy.