Why they looked at my face?

Because it would be rude to stare at someone's .... I think. (And staring at someone's only lands you in trouble) Besides, people will try to look at the offender's face instead. Easier to ID, no?