Well I would say you just chose ANOTHER sensible path with tradeoffs just like frontier API/subscriptions. Yes you get 100% control, cheaper inference, not having to stare at status.claude.com for like 2 hours per week, complete privacy (assuming local hosting or self hosting on servers).
But, you can’t get Fable level performance. OSS has reliably trailed the frontier by like 4-7 months for years now
Exactly, and insert meme "why not both?" I run local models for plenty of things, but for work there's a lot of complexity and Fable handled it so much better than any open model has so far. It's not really a choice for some domains currently.
Comments
Well I would say you just chose ANOTHER sensible path with tradeoffs just like frontier API/subscriptions. Yes you get 100% control, cheaper inference, not having to stare at status.claude.com for like 2 hours per week, complete privacy (assuming local hosting or self hosting on servers).
But, you can’t get Fable level performance. OSS has reliably trailed the frontier by like 4-7 months for years now
Exactly, and insert meme "why not both?" I run local models for plenty of things, but for work there's a lot of complexity and Fable handled it so much better than any open model has so far. It's not really a choice for some domains currently.