Comment on Ask HN: Affordable hardware for running local large language models?Comments−ysleepy2yI simply bought 4x32GB ddr4 memory (~200 bucks) for a normal desktop mainboard and a high-thread-count cpu.You can experiment with a lot of models, it's just going to be slow.With ddr5 you can even go higher with 48GB modules.Otherwise I got a 3060 12G, which can be had for 200€ used.Its a very affordable setup.
Comments
I simply bought 4x32GB ddr4 memory (~200 bucks) for a normal desktop mainboard and a high-thread-count cpu.
You can experiment with a lot of models, it's just going to be slow.
With ddr5 you can even go higher with 48GB modules.
Otherwise I got a 3060 12G, which can be had for 200€ used.
Its a very affordable setup.