Skip to content

Comment on Are LLMs able to play the card game Set?

Comments

I noticed that LLM at least at the Claude and OpenAI 4o level can not play tic tac toe and win against a competent opponent. They make illogical moves.

Interestingly, they can write a piece of code to solve Tic Tac Toe perfectly without breaking a sweat.

I've always said that appending "use python" to your prompt is a magic phrase that makes 4o amazingly powerful across a wide range of tasks. I have a whole slew of things in my memories that nudge it to use python when dealing with anything even remotely algorithmic, numeric, etc

Playing tic tac toe could be such a basic topic that there is relatively little information on the internet about how to "always" win.

On the other hand writing a piece of code to solve Tic Tac Toe sounds like it could be a relatively common coding challenge.

Win or stalemate? because a stalemate is the likely scenario against a somewhat competent opponent IMO.

Ahh good correction, I meant the winning strategy is to force a stalemate.

In all of my tests Claude nor 4o can even get to a stalemate, they just make incorrect moves.

It might be the way you're formatting the input. I wonder how they perform when state updates are shared via natural language vs ASCII art vs image

I tried a bunch of different ways. It wasn’t the prompt or input format.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.