Skip to content

Comment on How to run DeepSeek R1 locally

Comments

By default, this downloads the main DeepSeek R1 model (which is large). If you’re interested in a specific distilled variant (e.g., 1.5B, 7B, 14B), just specify its tag

No… it downloads the 7B model by default. If you think that is large, then you better hold on to your seat when you try to download the 671B model.

then you better hold on to your seat when you try to download the 671B model.

I ended up downloading it in case it ever gets removed off the internet for whatever reason. Who knows, if VRAM becomes much cheaper in 10 years I might be able to run it locally without spending a fortune on GPUs!

Maybe you could share information about the size of the different packages?

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.