Yes, I believe that will be the case. IBM already made the bet with granite models.
Personally, I've found that with guardrails, local 8-14B models can match frontier models on agentic tasks. The key is simple tasks with volume. For very complex things, the big models win. But a simple HR agent auditing 30,000 employee records to make sure all your info is filled out correctly, one at a time? You don't need frontier size for that.
Yes, this! I do similar things with local models. Small tasks at volume. I also use local models for things that demand more privacy ... managing or dealing with content I wouldn't want to send to the cloud.
Comments
Yes, I believe that will be the case. IBM already made the bet with granite models.
Personally, I've found that with guardrails, local 8-14B models can match frontier models on agentic tasks. The key is simple tasks with volume. For very complex things, the big models win. But a simple HR agent auditing 30,000 employee records to make sure all your info is filled out correctly, one at a time? You don't need frontier size for that.
Yes, this! I do similar things with local models. Small tasks at volume. I also use local models for things that demand more privacy ... managing or dealing with content I wouldn't want to send to the cloud.