Crypto energy requirements go up as the currency gets more traction.
TFA shows that groq is many times faster than GPT-4.
Up to 18x groq claims. Faster means less energy.
So I think it's just a matter of time until these things become ridiculously power efficient (eg run on phones in sub second times)
Presumably. Less time the giant chip has to draw power for computation.
The point is that everyone's interested in making AI power efficient, while crypto's proof of work is a competition for more power burned hashing and throwing away the result.
It's still a monstrosity compared to a traditional parser. You can even be fancy and use complex parsers that backtrack and can deal with mildly context-sensitive languages (as required for HTML, XML, and many programmin languages), and you'd still be more efficient.
TFA shows that groq is many times faster than GPT-4. Up to 18x groq claims. Faster means less energy. So I think it's just a matter of time until these things become ridiculously power efficient (eg run on phones in sub second times)