Llama2 on Replicate faster than ChatGPT?github.com/BerriAI 1 pointij233 years ago2 commentsSaveHideCopy link On HNComments−ij23OP3yRan some testing and discovered llama2 on replicate is faster than chatgpt!Code - https://github.com/BerriAI/litellm/blob/main/cookbook/Evalua...Are others seeing similar results?−agnokapathetic3yThe response time you get from a Pay-as-you-Go account on OpenAI is not anything close to what you get with an Enterprise Agreement. If your usage is large enough, talk to your account rep.
Comments
Ran some testing and discovered llama2 on replicate is faster than chatgpt!
Code - https://github.com/BerriAI/litellm/blob/main/cookbook/Evalua...
Are others seeing similar results?
The response time you get from a Pay-as-you-Go account on OpenAI is not anything close to what you get with an Enterprise Agreement. If your usage is large enough, talk to your account rep.