Another reason to avoid "I'll get downvoted for this" is the possibility that moderators will consider it a violation of HN's guidelines. In general, whinging about upvotes and downvotes is discouraged:

Please don't comment about the voting on comments. It never does any good, and it makes boring reading.

I sometimes downvote comments about voting to help enforce moderation. What I think is interesting about the topic of commenting on voting on comments is that the vast majority of my downvotes are fat finger mistakes while scrolling.