Skip to content

Comment on Claude Sonnet 5 – benchmark results

Comments

Yet another mediocre model. Mostly irrelevant among open weights alternatives. Fable wen.

I used sonnet five today to evaluate work I’m doing on an experimental programming language with an interesting concurrency model.

I asked it to try to figure out why one of the examples wasn’t working.

It read the implementation of the compiler and the runtime, found the bug, fixed it, fixed the example and the only thing I had to do manually is suggest a less silly name for a particular function.

I would use sonnet 5 for coding … seems alright!

Agree. It is a mediocre model, expensive while not being a frontier

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.