Comment on My bytecode optimizer beats Copilot by 2xComments−Kuinox1yAuthor used copilot in rider, tbh it's one of the worst rider. Which llm model was used ? VSCode&VS copilot allow you to select it.I suspect theses bench were run on the default model, ChatGPT 4o, which is now more than a year old.−top256OP1yOh good point which one should I use? I ran it alos with o3 and claude sonnet but the results were similar or worst.(Some are in the repo)
Comments
Author used copilot in rider, tbh it's one of the worst rider. Which llm model was used ? VSCode&VS copilot allow you to select it.
I suspect theses bench were run on the default model, ChatGPT 4o, which is now more than a year old.
Oh good point which one should I use? I ran it alos with o3 and claude sonnet but the results were similar or worst.(Some are in the repo)