Comment on OpenAI o1 Results on ARC-AGI-PubparentComments−usaar3331yarc reasoning challenge. I'm going to give you 2 example input/output pairs and then a third bare input. Please produce the correct third output.It used its COT to understand cornering -- then I got it to write a program.But as I try again, it's not reliable.−exe341yBut as I try again, it's not reliable.this is why I will never try anything like this on a remote server I don't control. all my toy experiments are with local llms that I can make sure are the same ones day after day.
Comments
arc reasoning challenge. I'm going to give you 2 example input/output pairs and then a third bare input. Please produce the correct third output.
It used its COT to understand cornering -- then I got it to write a program.
But as I try again, it's not reliable.
this is why I will never try anything like this on a remote server I don't control. all my toy experiments are with local llms that I can make sure are the same ones day after day.