I assume what you mean is that the CPU may get faster but would ultimately stall waiting for data, which can only move so fast. Presumably to continue feeding data to the CPU we'd want to be much more aggressive about caching and prefetching.

Another option would be to not go 100x faster but to go 10x faster and then take the improved cooling + energy usage as a win.