Huge fan of ollama. Although this is the first official linux release, I've been using it on linux already for a few months now with no issues (through the arch package which builds from source).
Getting started was literally as easy as:
pacman -S ollama
ollama serve
ollama run llama2:13b 'insert prompt'
Comments
Huge fan of ollama. Although this is the first official linux release, I've been using it on linux already for a few months now with no issues (through the arch package which builds from source).
Getting started was literally as easy as:
You guys are doing the lord's work here"You guys are doing the lord's work here"?
How? By forcing users into a custom model serialization format (GGUF) that is claimed to literally contain "magic"?
Dark lord, maybe.