I think that's still not a safe assumption, I don't think it's understood enough to know if the poor performance isn't just a fundamental limitation of some kind. You can already see models taking alternative approaches as they hit diminishing returns on the transformer innovation that triggered the massive improvement. I am just a punter onlooking though, no expert.