Skip to content

Comment on Structured Outputs with Ollamaparent

Comments

Why do smaller models fail to follow? Isn't the objective of constraints that it always provides the right output type?

The constraints will always be met. It’s the data inside that might be inaccurate. YMMV with smaller models in that sense.

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.