I love the idea of not only trying to improve models by giving them more "cognitive" power, but also by improving the harness, where improvements seem to be very low hanging fruits compared to advancing frontier models. This could make older/smaller models also viable for coding agents.
Hey @joknoll - in the benchmarks, I'm seeing very positive results with Haiku, getting quicker and more correct answers. So I think you're absolutely right that harness improvements will be a natural part of "sharpening" most models - especially the smaller ones with less reasoning capability.
Comments
I love the idea of not only trying to improve models by giving them more "cognitive" power, but also by improving the harness, where improvements seem to be very low hanging fruits compared to advancing frontier models. This could make older/smaller models also viable for coding agents.
Hey @joknoll - in the benchmarks, I'm seeing very positive results with Haiku, getting quicker and more correct answers. So I think you're absolutely right that harness improvements will be a natural part of "sharpening" most models - especially the smaller ones with less reasoning capability.