If you have enough passing candidates that you can do additional filtering on irrelevant reasons, that means your hiring bar is lower than it could be.

Also, since when is being "diverse" a property of an individual rather than a group?