Comment on GroqchatparentComments−visarga2yAlso make a long context Mistral-7B that spits 1000T/s−tome2yI'll do it if you promise to say "wow!" :D−tome2yHere you go:https://www.youtube.com/watch?v=9c078xKGwdUIt's 850 tokes per second, so you don't have to say "wow" yet!
Comments
Also make a long context Mistral-7B that spits 1000T/s
I'll do it if you promise to say "wow!" :D
Here you go:
https://www.youtube.com/watch?v=9c078xKGwdU
It's 850 tokes per second, so you don't have to say "wow" yet!