Comment on The End of Moore's Law for AI? Gemini Flash Offers a WarningparentComments−sethkimOP1yYes! Both Llama 3 and Gemma 3 have 128k context windows.−ryao1yLlama 3 had a 8192 token context window. Llama 3.1 increased it to 131072.
Comments
Yes! Both Llama 3 and Gemma 3 have 128k context windows.
Llama 3 had a 8192 token context window. Llama 3.1 increased it to 131072.