Comment on Show HN: Smart model routing directly in Claude, Codex and CursorComments−reliablereason2moWont this kill the kv cache?Also i am pretty sure neither open ai or anthropic leets you seed the agents own tokens.−adchurchOP2moVery important consideration, addressed it in another thread (https://news.ycombinator.com/item?id=48689448). tl;dr we built this to be cache aware for exactly this reason
Comments
Wont this kill the kv cache?
Also i am pretty sure neither open ai or anthropic leets you seed the agents own tokens.
Very important consideration, addressed it in another thread (https://news.ycombinator.com/item?id=48689448). tl;dr we built this to be cache aware for exactly this reason