openai json mode will ensure JSON, but not strictly the right JSON schema to match whatever object you're expecting to return. Keys could be missing, fields could be improperly typed. We found gpt-4 reasoning capabilities could, most of the time, make it work, but that's overkill for many
Comments
How does it differentiate from using json output with OpenAI?
I think it can be useful for some cases, but you’ll always have the limitation of the model size to compete against large closed source models.
openai json mode will ensure JSON, but not strictly the right JSON schema to match whatever object you're expecting to return. Keys could be missing, fields could be improperly typed. We found gpt-4 reasoning capabilities could, most of the time, make it work, but that's overkill for many