Comment on Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, CachingComments−bredren3yThis makes sense to me. I’d previously mentioned here [1]:…can’t people just build their product with openAI or other and plan to move away based on the cost and fit for their circumstances?Couldn’t someone say prototype the entire product on some lower-quality LLM and occasionally pass requests to GPT4 to validate behavior?This seems to reduce the switching costs to almost nothing.[1] https://news.ycombinator.com/item?id=36626943−detente183yIf you'd like to add any of these ideas as notebooks to our cookbook - https://github.com/BerriAI/litellm/tree/main/cookbook, we'd love the contribution!−detente183yThose are really cool use-cases. I wrote a bit about our initial motivation for LiteLLM here - https://hackernoon.com/litellm-call-every-llm-api-like-its-o....tldr; reliable model switching involved multiple 100-line if/else statements, which made our code messy, and debugging in prod pretty hard.
Comments
This makes sense to me. I’d previously mentioned here [1]:
This seems to reduce the switching costs to almost nothing.
[1] https://news.ycombinator.com/item?id=36626943
If you'd like to add any of these ideas as notebooks to our cookbook - https://github.com/BerriAI/litellm/tree/main/cookbook, we'd love the contribution!
Those are really cool use-cases. I wrote a bit about our initial motivation for LiteLLM here - https://hackernoon.com/litellm-call-every-llm-api-like-its-o....
tldr; reliable model switching involved multiple 100-line if/else statements, which made our code messy, and debugging in prod pretty hard.