The way it failed to maintain its strategy, or even its build plans, makes me wonder if this is something that could be solved via the attention mechanism itself?

Instead of only using attention to focus on the previous token position, could it also do some kind of higher order "temporal attention" planning where it weighs each previous log (game state + intent) checkpoint when generating outputs?