Comment on I built an LLM router that doesn't use an LLMComments−tcballardOP2moMost routing systems I found either used another model as a classifier or relied on provider-specific routing. I was interested in the narrower question: how far can deterministic heuristics get before you actually need another model in the loop?
Comments
Most routing systems I found either used another model as a classifier or relied on provider-specific routing. I was interested in the narrower question: how far can deterministic heuristics get before you actually need another model in the loop?