Skip to content

Comment on SubQ 1.1 Smallparent

Comments

A full breakdown of the mechanism and how it compares to FlashAttention, DeepSeek sparse attention, and recurrent architectures is in the Technical Report.

Oh they did publish details lets read the technical report!

The mechanism by which SSA meets these requirements is outside the scope of this report

TFGs...

AboutSource Built by g1lg1l

Hackerly is an independent reader for Hacker News, built on the public HN API. Not affiliated with Y Combinator.