For those wondering how to answer "what do you want to see from an open model" I put this in: an open weights end to end multimodal model, a model large enough to act as a functional teacher along with a range of nicely distilled smaller sizes, code repo to make training / finetuning easy.
As I write this, I'd also like to request a set of tool calling LLMs in various sizes. Feels to me like a small fast local tool calling assessor with a large context to support a lot of MCP functions would be very useful locally.
I think that when learning privacy and being able to run things oneself is less of a problem.
Keeping ones work confidential becomes interesting once one starts doing new things, so while it would be fun, I don't think that's the most useful type of open model. I think code models are probably the most useful.
I don’t think it will be an end to end multimodal model, unless they’re holding that shocker for later - he says “language model” in the announcement. So basically o3 mini, not 4o multimodal.
Comments
For those wondering how to answer "what do you want to see from an open model" I put this in: an open weights end to end multimodal model, a model large enough to act as a functional teacher along with a range of nicely distilled smaller sizes, code repo to make training / finetuning easy.
As I write this, I'd also like to request a set of tool calling LLMs in various sizes. Feels to me like a small fast local tool calling assessor with a large context to support a lot of MCP functions would be very useful locally.
How about everything needed for full reproducibility?
This is what I would like to see
Seems unlikely. :) As is an end to end multimodal model, I'd guess. But we can ask!
Id hope they will also start to target machines with 128gb of unified ram now that we seem to have at least 3 options on that front.
I'd rather see more openness and the ability to run on commodity hardware. There are hundreds of options on that front.
I think that when learning privacy and being able to run things oneself is less of a problem.
Keeping ones work confidential becomes interesting once one starts doing new things, so while it would be fun, I don't think that's the most useful type of open model. I think code models are probably the most useful.
and guess what
they did announce they'll release open weights :)
https://x.com/sama/status/1906793591944646898?s=46&t=6NqVriD...
to be honest many of us never saw that coming... LOL
I don’t think it will be an end to end multimodal model, unless they’re holding that shocker for later - he says “language model” in the announcement. So basically o3 mini, not 4o multimodal.