Skip to content

Comment on Ollama for Linux – Run LLMs on Linux with GPU Accelerationparent

Comments

Offer two builds :) One AMD and one NVIDIA.

Possibly, but a core guiding principle for us is to keep everything as simple as possible. We're a small project, so if we add too many features/permutations it really makes it hard to keep everything working!

permutations

I don't believe that AMD/NVIDIA is a low entropy bit so far as configuration permutations go. Although NVIDIA is far more widespread, AMD has significant market share. The Darwin bit you already facilitate for is probably lower entropy.

Also, some of us weird folk have both an AMD and NVIDIA GPU in one machine...

Actually, I guess that is more common now that AMD CPUs have a GPU built in?

You could download both binaries for that scenario.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.