Groq with llama3 70b is so fast and good enough for what we do (source code stuff) that it’s really quite painful to work with most others now. We replaced most our internal integrations with this and everything is great so far. I guess they will be bought soon?
Comments
Groq with llama3 70b is so fast and good enough for what we do (source code stuff) that it’s really quite painful to work with most others now. We replaced most our internal integrations with this and everything is great so far. I guess they will be bought soon?
How is that possible with Groq rate limits?
Fireworks has Llama 3 for the same effective speed with much more realistic rate limits (and billing)
Groq relaxes the rate limits if you work 'closer' with them.
how do you work closer? we filled out the enterprise form and I DMd a mod in the Discord..
What do you guys do?