Llama3 Performance Cost Benchmarkparseur.com 2 pointsjoss822 years ago1 commentSaveHideCopy link On HNComments−joss82OP2yI spent the last few days testing Llama3 on different GPUs, to find the cheapest cost per token. Spoiler: it's the Nvidia L4, surprisingly.
Comments
I spent the last few days testing Llama3 on different GPUs, to find the cheapest cost per token. Spoiler: it's the Nvidia L4, surprisingly.