I suspect it is its own model. Running it on 10B+ user queries per day you're gonna want to optimize everything you can about it - so you'd want something really optimized to the exact problem rather than using a general purpose model with careful prompting.
Comments
It turns out someone has written a plugin for my LLM CLI tool already: https://github.com/irthomasthomas/llm-cerebras
You need an API key - I got one from https://cloud.cerebras.ai/ but I'm not sure if there's a waiting list at the moment - then you can do this:
Then you can run lightning fast prompts like this: Here's a video of that running, it's very speedy: https://static.simonwillison.net/static/2024/cerebras-is-fas...It has a waiting list
The "AI overview" in google search seems to be a similar speed, and the resulting text of similar quality.
I wonder which of their models they use. Might even be Gemini 1.5 Flash 8B which is VERY quick.
I just tried that out with the same prompt and it's fast, but not as fast as Cerebras: https://static.simonwillison.net/static/2024/gemini-flash-8b...
I suspect it is its own model. Running it on 10B+ user queries per day you're gonna want to optimize everything you can about it - so you'd want something really optimized to the exact problem rather than using a general purpose model with careful prompting.