We ultimately need optimized DSLs and aggressive use of stateless sub-modules/abstractions that can be implemented in isolation to minimize the amount of context required for any one LLM invocation.
Containment of state also happens to benefit human developers too, and keep complexity from exploding.
I've found the same principles that apply to humans apply to LLMs as well.
Just that the agentic loops in these tools aren't (currently) structured and specific enough in their approach to optimally bound abstractions.
At the highest level, most applications can be written in simple, plain english (expressed via function names). Both humans and LLMs will understand programs much better when represented this way
Comments
Containment of state also happens to benefit human developers too, and keep complexity from exploding.
Yes!
I've found the same principles that apply to humans apply to LLMs as well.
Just that the agentic loops in these tools aren't (currently) structured and specific enough in their approach to optimally bound abstractions.
At the highest level, most applications can be written in simple, plain english (expressed via function names). Both humans and LLMs will understand programs much better when represented this way