Comment on GroqchatparentComments−tome2yWe don't have an API in public availability yet but that's coming soon in the new year. We will be price competitive with OpenAI but much faster. Deploying Mixtral is work in progress so keep your eyes open for that too!−visarga2yAlso make a long context Mistral-7B that spits 1000T/s−tome2yI'll do it if you promise to say "wow!" :D−tome2yHere you go:https://www.youtube.com/watch?v=9c078xKGwdUIt's 850 tokes per second, so you don't have to say "wow" yet!
Comments
We don't have an API in public availability yet but that's coming soon in the new year. We will be price competitive with OpenAI but much faster. Deploying Mixtral is work in progress so keep your eyes open for that too!
Also make a long context Mistral-7B that spits 1000T/s
I'll do it if you promise to say "wow!" :D
Here you go:
https://www.youtube.com/watch?v=9c078xKGwdU
It's 850 tokes per second, so you don't have to say "wow" yet!