Comment on Don't Put All Your Tokens in One BasketComments−plumman12modon't litellm and similar do this already?−santiago-pl1moActually, LiteLLM is the most popular, it was first product of this type, but there is plenty of more efficient and reliable alternate AI Gateways right now. I've written one - GoModel. https://gomodel.enterpilot.io/−rafaelnexusOP1moAbsolutely, a pretty good one.
Comments
don't litellm and similar do this already?
Actually, LiteLLM is the most popular, it was first product of this type, but there is plenty of more efficient and reliable alternate AI Gateways right now. I've written one - GoModel. https://gomodel.enterpilot.io/
Absolutely, a pretty good one.