Skip to content

Comment on Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, Cachingparent

Comments

Hey @jmorgan - we love ollama!

Re: LocalLLM's like Llama2 - yes we support self-deployed models, through Huggingface, Replicate, TogetherAI integrations.

We're missing support for locally deployed models - and would love the help!

Re: ollama - we spent a couple hours trying to integrate ollama. We had a couple issues though, would love to try and support it. Got time to chat sometime this/next week? I think this would be an awesome addition.

Great. Let's chat!

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.