It is a statistical machine but it is not over bare words/tokens, it effectively operates over a “concept space” that it learns during training.

(Granted the definition of “statistical machine” is quite vague and different folks might define that differently…)