Comment on Quantitative AI progress needs accurate and transparent evaluationparentComments−JohnKemeny1yDon't put Google and ChatGPT in the same category here. Google cooperated with the organizers, at least.−ml-anon1yAlso neither got a gold medal. Both solved problems to meet the threshold for a human child getting a gold medal but it’s like saying an F1 car got a gold medal in the 100m sprint at the Olympics.−bwfan1231yThe popular science title was funnier with a pun on "mathed" [1]"Human teens beat AI at an international math competition Google and OpenAI earned gold medals, but were still out-mathed by students."[1] https://www.popsci.com/technology/ai-math-competition/−nmca1yIndeed, it’s like saying a jet plane can fly!−vdfs1y"Google F1 Preview Experimental beat the record of the fastest man on earth Usain Bolt"−spuz1yCould you clarify what you mean by this?−raincole1yGoogle's answers were judged by IMO. OpenAI's were judged by themselves internally. Whether it matters is up to the reader.−EnnEmmEss1yTheZvi had a summarization of this here: https://thezvi.substack.com/i/168895545/not-announcing-so-fa...In short (there is nuance), Google cooperated with the IMO team while OpenAI didn't which is why OpenAI announced before Google.
Comments
Don't put Google and ChatGPT in the same category here. Google cooperated with the organizers, at least.
Also neither got a gold medal. Both solved problems to meet the threshold for a human child getting a gold medal but it’s like saying an F1 car got a gold medal in the 100m sprint at the Olympics.
The popular science title was funnier with a pun on "mathed" [1]
"Human teens beat AI at an international math competition Google and OpenAI earned gold medals, but were still out-mathed by students."
[1] https://www.popsci.com/technology/ai-math-competition/
Indeed, it’s like saying a jet plane can fly!
"Google F1 Preview Experimental beat the record of the fastest man on earth Usain Bolt"
Could you clarify what you mean by this?
Google's answers were judged by IMO. OpenAI's were judged by themselves internally. Whether it matters is up to the reader.
TheZvi had a summarization of this here: https://thezvi.substack.com/i/168895545/not-announcing-so-fa...
In short (there is nuance), Google cooperated with the IMO team while OpenAI didn't which is why OpenAI announced before Google.