Comment on Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, CachingparentComments−reustle3yYou can definitely start by checking out ollama, it was super helpful for me−marcopicentini3yIt’s only for MacOSX. I expect to load the model on a Ubuntu server, not on my local dev machine.−Menatombo3yYou have to build it if you want it for Ubuntu, Windows, or anything else. Just build Go on your machine and have at it.
Comments
You can definitely start by checking out ollama, it was super helpful for me
It’s only for MacOSX. I expect to load the model on a Ubuntu server, not on my local dev machine.
You have to build it if you want it for Ubuntu, Windows, or anything else. Just build Go on your machine and have at it.