The alternative is to switch to far more efficient models and have aggressive optimization of efficiency as part of the process of improvement.

There are at least two resources here that have a Pareto optimal front: time and energy. And effort spent to change the shape of that may pay off more than efforts spent purely on improving intelligence and agency.