Skip to content

ProgramBench

vals.ai
4 pointsvinhnx2 comments
On HN

Comments

The interesting question; can it rebuild it from access to a web UI?

It's going to be incredible when I can point AI at a proprietary program, and tell AI that I want something like that, but with some annoyance fixed. And suddenly, I saved a ton of monthly subscription fees, and have better software, without any real effort.

Did Vals run all those benchmarks themselves? A bunch of these models don't show up on the official ProgramBench leaderboard. https://programbench.com/extended/

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.