Comment on How well do agents use test/verification techniques?parentComments−ngruhn4dI thought so too but it's probably because I never review the tests. I made an exception recently and found tons of assert(CONSTANT_CONFIG == valueOfConfig) or tests for keywords in prompts: assert(prompt.includes("repo url"))−genxy2dWas your prompt, "make lazy ineffectual tests?" Tests are code as well, they take the same effort to create, if not more. You need to specify the properties you want to test.
Comments
I thought so too but it's probably because I never review the tests. I made an exception recently and found tons of
or tests for keywords in prompts:Was your prompt, "make lazy ineffectual tests?" Tests are code as well, they take the same effort to create, if not more. You need to specify the properties you want to test.