Comment on Kaist develops next-generation ultra-low power LLM acceleratorparentComments−fzzzy2yYou need computers for all of them and megawatts of power, power supplies, cooling, and power distribution.−int_19h2yNaturally, but you need that for GPUs as well, no? What is the actual difference when running, when measured per token generated?
Comments
You need computers for all of them and megawatts of power, power supplies, cooling, and power distribution.
Naturally, but you need that for GPUs as well, no? What is the actual difference when running, when measured per token generated?