You are on the right track, but no, it is more subtle than that. The test could still be meaningful depending on what probability of false positives you are willing to accept.

[1] http://en.wikipedia.org/wiki/P-value

[2] http://en.wikipedia.org/wiki/Type_I_and_type_II_errors