articles like this need to factor in the overall time/effort tradeoff in developing the set of prompts necessary to reach an overall goal... for example, if I can achieve the same results while being sloppy/lazy/vague with my prompts, I wouldn't bother with the extra discipline or time expended to craft "to spec" prompts
agreed. I'd also love to see more comparisons like this.
I do think that a well speced out prompt can be finished faster by an agent then if prompted lazily. I've also found measuring this to be challenging, since issues that come from lazy prompting can hide until its too late to pinpoint exactly what prompt introduced them. But maybe this should be the new "git blame"... gears are already turning for what evals could look like for this.
Comments
articles like this need to factor in the overall time/effort tradeoff in developing the set of prompts necessary to reach an overall goal... for example, if I can achieve the same results while being sloppy/lazy/vague with my prompts, I wouldn't bother with the extra discipline or time expended to craft "to spec" prompts
agreed. I'd also love to see more comparisons like this.
I do think that a well speced out prompt can be finished faster by an agent then if prompted lazily. I've also found measuring this to be challenging, since issues that come from lazy prompting can hide until its too late to pinpoint exactly what prompt introduced them. But maybe this should be the new "git blame"... gears are already turning for what evals could look like for this.