Comment on Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, CachingComments−danielbln3yCan you say more about the semantic caching, I can't seem to find much in the docs.edit: Found the cache notebook[1] and the calls to the cache and distance eval in the code[2][1] https://github.com/BerriAI/litellm/blob/main/cookbook/liteLL...[2] https://github.com/BerriAI/litellm/blob/80d77fed7123af222011...
Comments
Can you say more about the semantic caching, I can't seem to find much in the docs.
edit: Found the cache notebook[1] and the calls to the cache and distance eval in the code[2]
[1] https://github.com/BerriAI/litellm/blob/main/cookbook/liteLL...
[2] https://github.com/BerriAI/litellm/blob/80d77fed7123af222011...