Maybe it's some sort of evolutionary fear, like when a lion keeps staring at the antelope

Also, it violates our sense of fairness. A security camera is watching everyone equally. Suppose we do the same with 1000 cameramen following 1000 people in the same square, how would people react?