Comment on Ask HN: What AI assistants are already bundled for Linux?Comments−yjftsjthsd-h2yNixOS has packages for llama-cpp and ollama: https://search.nixos.org/packages?channel=23.11&from=0&size=...Edit: And Arch packages ollama officially - https://archlinux.org/packages/?sort=&q=llama&maintainer=&fl... - and a few things in the AUR - https://aur.archlinux.org/packages?O=0&K=llama−ghthor2yNixOS just got tabbyml[1] which is built on llama-cpp. Working on systemsd services the weekend and updating latest tabbyml release which supports rocm in addition to cuda[1] https://github.com/TabbyML/tabby[2] https://github.com/NixOS/nixpkgs/pull/291744−ghthor2ySystemd service PR posted to nixpkgshttps://github.com/NixOS/nixpkgs/pull/292873
Comments
NixOS has packages for llama-cpp and ollama: https://search.nixos.org/packages?channel=23.11&from=0&size=...
Edit: And Arch packages ollama officially - https://archlinux.org/packages/?sort=&q=llama&maintainer=&fl... - and a few things in the AUR - https://aur.archlinux.org/packages?O=0&K=llama
NixOS just got tabbyml[1] which is built on llama-cpp. Working on systemsd services the weekend and updating latest tabbyml release which supports rocm in addition to cuda
[1] https://github.com/TabbyML/tabby
[2] https://github.com/NixOS/nixpkgs/pull/291744
Systemd service PR posted to nixpkgs
https://github.com/NixOS/nixpkgs/pull/292873