I think I've heard "Pardon my English" before too. I wouldn't be at all offended if I heard that term. In fact, I'll make a point of using it in the future. :)