Skip to content

Where did my 128GB of video RAM go? AMD GPU BIOS gotcha for LLM builders

patrickmccanna.net
2 points0o_MrPatrick_o02 comments
On HN

Comments

Adding amdgpu.gttsize=126976 and ttm.pages_limit=32505856 to the kernel parameters, while setting the VRAM in the BIOS to the minimum value, enables unified memory to work as expected on AMD Strix Halo running Linux.

The https://strixhalo.wiki has most of the info you need to get LLMs running on these machines.

Thank you for the pointers!!

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.