Comment on Cerebras Inference now 3x faster: Llama3.1-70B breaks 2,100 tokens/sparentComments−croes1yExactly, validating and rewriting the prompt are the real time consuming tasks.
Comments
Exactly, validating and rewriting the prompt are the real time consuming tasks.