Comment on Sampling and structured outputs in LLMsparentComments−esafak11moWhen you say custom grammar, do you mean something other than a JSON schema, because they support that?−thrance11moI mean, most don't? I know you can provide a pseudo-EBNF grammar to llama.cpp but, for example, none of Anthropic, Azure, Bedrock, Mistral or Gemini allow us the same.
Comments
When you say custom grammar, do you mean something other than a JSON schema, because they support that?
I mean, most don't? I know you can provide a pseudo-EBNF grammar to llama.cpp but, for example, none of Anthropic, Azure, Bedrock, Mistral or Gemini allow us the same.