Skip to content

Comment on TinyLoRA – Learning to Reason in 13 Parametersparent

Comments

Fair points, especially on GSM8K saturation and Qwen possibly already sitting close to the solution. That said, even if this is mostly "last-mile alignment", the fact that it can be done with such a tiny signal is still interesting, it suggests the gap between capability and behavior might be much smaller (and cheaper to bridge) than we assume.

the gap between capability and behavior might be much smaller

Can you elaborate a bit on what you mean with the gap?

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.