As I understood the story (the photo of the ballot that is sometimes circulated is just one taken from Twitter), the ballot had Brexit written all over it, and an arrow pointing at the Tory candidate's name, so ended up counting it as a Tory vote because of that.