Skip to content

Comment on How well do agents use test/verification techniques?

Comments

I've had good luck with audit technique, specifically with mixing LLMs that have very different heritage.

Mostly write code with GLM5.3 and found that using Muse 1.3 to make detailed summary bugs works well, especially for Rust. Somehow muse is really good at rust. And from what I can tell even using the original model (GLM here) against that list to go fix it seems fine even if it is the model that made the mistake.

They seem to write 100s of tests too, but don't really have much confidence in those tbh much like author. I view it as a bonus. Tests are computationally cheap so knock yourself out Mr AI.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.