one obvious constraint would be the importance of facial expression in human interactions. How many facial muscles are purely mimic? I'd say most of them.
Eyeballs are not that squishy and one could argue that that deep eyesockets are actually protective - it's rather unlikely to do damage to eyes when the surrounding bone takes the hit, especially with a fist. The nose looks like a bad design though.