Numpy is basically lapack. You'd be hard pressed to replace that with something nearing its performance. For autodiff, I dunno, how about John Mount's explanation?

http://www.win-vector.com/blog/2010/06/automatic-differentia...