Interesting. I tend to imagine the exact opposite - it seems as though this is the big players realizing there's not much left from training better models, so they're focusing on scaffolding to get their improvements. If that's the case, why wouldn't a company completely devoted to the scaffolding not do a better job at that goal? And more importantly, why would I lock myself into their system?
Comments
Interesting. I tend to imagine the exact opposite - it seems as though this is the big players realizing there's not much left from training better models, so they're focusing on scaffolding to get their improvements. If that's the case, why wouldn't a company completely devoted to the scaffolding not do a better job at that goal? And more importantly, why would I lock myself into their system?
Because the model labs can RL against their own scaffold, which will be borderline unbeatable