Comment on Cerebras Inference now 3x faster: Llama3.1-70B breaks 2,100 tokens/sparentComments−swores1yDoes it run well on CPU? I've used it locally but only with my high end (consumer/gaming) GPU, and haven't got round to finding out how it does on weaker machines.−Arn_Thor1yIt’s not fast but if your transcript doesn’t have to get out ASAP it’s fine
Comments
Does it run well on CPU? I've used it locally but only with my high end (consumer/gaming) GPU, and haven't got round to finding out how it does on weaker machines.
It’s not fast but if your transcript doesn’t have to get out ASAP it’s fine