Setting aside buzzwords, how are people currently dealing with the problem of LLM errors propagating/accumulating through a pipeline? All of these model call feeding into model calls feeding into model calls results in a pretty low probability that the overall task stays on a happy path. And adding even more calls to guardrail the steps adds compounding latency.
Comments
Setting aside buzzwords, how are people currently dealing with the problem of LLM errors propagating/accumulating through a pipeline? All of these model call feeding into model calls feeding into model calls results in a pretty low probability that the overall task stays on a happy path. And adding even more calls to guardrail the steps adds compounding latency.