Harassing someone is generally illegal, which can include following them around, usually to intimidate them.

If you are following someone in the matter the police would they won't know they are being followed, which is part of what private investigators do.

Just don't harass them. If they catch you and tell you to stop and you don't - then you are veering into harassment territory.