Apriel-H1: Towards Efficient Enterprise Reasoning Modelsarxiv.org 1 pointguiriduro8 months ago1 commentSaveHideCopy link On HNComments−guiriduroOP8moApriel-H1-15b-Thinker-SFT uses incremental distillation from Apriel-Nemotron-15B-Thinker, selectively replacing less critical attention layers with linear Mamba blocks to reduce computational complexity while preserving reasoning quality.
Comments
Apriel-H1-15b-Thinker-SFT uses incremental distillation from Apriel-Nemotron-15B-Thinker, selectively replacing less critical attention layers with linear Mamba blocks to reduce computational complexity while preserving reasoning quality.