It's an acceptable usage, though I freely concede I overuse it when 'famous' would be more easily understood.
generally known and talked of; especially : widely and unfavorably known
http://www.merriam-webster.com/dictionary/notorious
flagrantly wicked or impious : evil
Origin: Latin nefarius, from nefas crime
http://www.merriam-webster.com/dictionary/nefarious