emmelaich on I ask this chess puzzle to every new LLM

Comment on I ask this chess puzzle to every new LLM

My goto is ask LLM to explain this poem (this is but on variation) ...

   Spring has sprung, the grass iz riz,
   I wonder where da boidies iz?
   Da boid iz on da wing! Ain’t that absoid?
   I always hoid da wing...wuz on da boid!

chatgpt up to o1 failed, o1 did very well. deepseek-r1 7b did ok too.

markisus 1y

I’m having a hard time with this one as a human.

Spring has sprung, grass has risen. I wonder where the birdies are? The bird is on the wing! Isn’t that absurd? I always heard the wing was on the bird!

Not sure what it means that the bird is on the wing.

janwillemb 1y

it means "in flight"

SideburnsOfDoom 1y

Not sure what it means that the bird is on the wing

Is this hard to find out? I mean it's easy to find this https://www.dictionary.com/browse/on-the-wing https://www.allgreatquotes.com/hamlet-quotes-114/

So it's somewhat old-timey English English.

And to explain the joke, the humour is that the rest of it is phonetic 20th century New York English. E.g. pronouncing "Absurd" more like "absoid" to rhyme with "boid".

New York guy finds Shakespearean English absoid.

The other commenter has this right, that now the joke has been explained on the internet, it will be harvested and LLMS will regurgitate variations on the explanations, then people will believe that the LLMs have become "more intelligent" in general. They have not, they just have more data for this specific test.

emmelaich 1y

Apparently it's "boids" because the version that was popular in the UK came from New Jersey!

Kim_Bruning 1y

Claude 3.5 Sonnet did rather well.

I get the impression it often does as well or better than o1 on many tasks, despite not being a reasoning model.

Comments