I would imagine it's partly an emotional thing; it's hard to blame the pilot or think that the pilot was negligent, when clearly any error he makes can be fatal to him as well as the passengers.

Whereas if a doctor makes a mistake, nothing really happens to him. Thus it's easier to imagine he's just being negligent / doesn't care, which generates more anger than an honest mistake.