In my experience building AI Agents, having more specialized agents works better than one big agent. Simply because LLMs are dumb and make A LOT of mistakes. The longer the system prompt and more instructions you give it, the more likely it will miss some of them.
For example, in one architecture, I used to have a support agent reply directly in the customer's language, but the translations were very poor. Now I have one agent thinking of the answer in English, and then one dedicated agent for translation. The translations are A LOT better now.
Comments
In my experience building AI Agents, having more specialized agents works better than one big agent. Simply because LLMs are dumb and make A LOT of mistakes. The longer the system prompt and more instructions you give it, the more likely it will miss some of them.
For example, in one architecture, I used to have a support agent reply directly in the customer's language, but the translations were very poor. Now I have one agent thinking of the answer in English, and then one dedicated agent for translation. The translations are A LOT better now.