Comment on Gemini 3 Pro vs. 2.5 Pro in Pokemon CrystalparentComments−zurfer8moYou're too kind. Even the CEO of Google retweeted how well Gemini 2.5 did on Pokemon. There is a high chance that now it's explicitly part of the training regime. We kind of need a different kind of game to know how well it generalizes.−kqr8moI have a draft doing this with text adventures: https://entropicthoughts.com/updated-llm-benchmark
Comments
You're too kind. Even the CEO of Google retweeted how well Gemini 2.5 did on Pokemon. There is a high chance that now it's explicitly part of the training regime. We kind of need a different kind of game to know how well it generalizes.
I have a draft doing this with text adventures: https://entropicthoughts.com/updated-llm-benchmark