From my experience it's a modularization technique. It makes it easier to reason about and improve the system. For example, instead of one big model capable of doing anything, you can separate the system into specialized subsystems with different prompts and improve them over time.