Touching can be classified as assault. If you're not getting a signal that you should touch someone, there's some risk in touching them.

If you get no signal that sexual touching is desired, then, most definitely, that touching constitutes assault and you can be arrested for it.