Comment on Zamba2-7BparentComments−epistasis1yTri Gao and Albert Gu say "Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality"https://arxiv.org/abs/2405.21060Mamba-2 is used in Zamab2.
Comments
Tri Gao and Albert Gu say "Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality"
https://arxiv.org/abs/2405.21060
Mamba-2 is used in Zamab2.