One rebuttal for this logic could be that everything you do has side effects. Messing up your health costs society tons of money in lost tax income and the burden on healthcare.
But as a starting point, I've thought the same in the past and I don't think it's bad. Just that crossing a red light, even if no one was harmed that particular instance, may still be judged to be reckless and fineable, and even if it's only about your own dead body (let's say you didn't run in front of a cyclist), that's still an impact in the way described above. Nevertheless, if you use "don't bother others" as a general rule for what should probably be legal and then define exceptions for particular situations and reasons, or even if you just look for those side effects, it might be useful.
But as a starting point, I've thought the same in the past and I don't think it's bad. Just that crossing a red light, even if no one was harmed that particular instance, may still be judged to be reckless and fineable, and even if it's only about your own dead body (let's say you didn't run in front of a cyclist), that's still an impact in the way described above. Nevertheless, if you use "don't bother others" as a general rule for what should probably be legal and then define exceptions for particular situations and reasons, or even if you just look for those side effects, it might be useful.