768GB Intel Optane DIMMs to run 1T-parameter LLM with single GPU at 4tpstomshardware.com 30 pointswalterbell3 months ago2 commentsSaveHideCopy link On HNComments−lostmsu3moThe bottleneck in this setup is PCIe bus. You don't need optane to saturate it. 4 regular SSDs might do just fine.−musicale3moAh Optane, what might have been...Even over PCIe, I imagine the advantage vs. NVMe is lower latency and more operations per second.
Comments
The bottleneck in this setup is PCIe bus. You don't need optane to saturate it. 4 regular SSDs might do just fine.
Ah Optane, what might have been...
Even over PCIe, I imagine the advantage vs. NVMe is lower latency and more operations per second.