Your reaction is understandable honestly (although perhaps not correct in the sense of what should be socially acceptable).

If somebody said that next to me in person, I'd probably punch them and apologize afterwards hehe.