LargoLasskhyfv on Ask HN: How can I experiment with LLMs with a old machine?

Make yourself comfortable with

or any other offer.

Deploy some minimal Linux on them, or use what's offered.

Plus optionally, if you don't want to instantly start coding from first principles/scratch, make use of established and excellent solutions, like

and parallelize them with

Obviously this needs some knowledge of the command line, so get a good terminal emulator like

Mend, bend, rend that stuff and see what works how and why, and what not.

Edit: Optionally, if you really want to go low-level, with some debugger like

for 'toy-installations' of smallest models.

'Toy' because that doesn't fully support the CPU-instructions which are used in production.

Could still help conceptually.

Thank you for the Mozilla AI guide, it's really useful! I knew some of Justine's work and they are really cool.

Comments