Comment on Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, CachingComments−breckenedge3yDoes it support the function-calling API? https://openai.com/blog/function-calling-and-other-api-updat...−detente183yHey @breckenedge yes it does! Exactly the same way as the openai-python sdk. Here's our code tutorial for it https://github.com/BerriAI/litellm/blob/main/cookbook/liteLL...−d4rkp4ttern3yWhat about streaming output — is there a uniform interface for all models for streaming output?−detente183yHi @d4rkp4ttern - yes it's standardized to the openai format - https://litellm.readthedocs.io/en/latest/stream/
Comments
Does it support the function-calling API? https://openai.com/blog/function-calling-and-other-api-updat...
Hey @breckenedge yes it does! Exactly the same way as the openai-python sdk. Here's our code tutorial for it https://github.com/BerriAI/litellm/blob/main/cookbook/liteLL...
What about streaming output — is there a uniform interface for all models for streaming output?
Hi @d4rkp4ttern - yes it's standardized to the openai format - https://litellm.readthedocs.io/en/latest/stream/