Comment on Scalable MatMul-Free Language ModelingComments−throwaway712712ythe github link in the paper: https://github.com/ridgerchu/matmulfreellmit is super easy to try it out, the 2.7B, 1.3B, 0.37B models are on huggingface, and the generate.py example just works if you have triton 2.2 installed
Comments
the github link in the paper: https://github.com/ridgerchu/matmulfreellm
it is super easy to try it out, the 2.7B, 1.3B, 0.37B models are on huggingface, and the generate.py example just works if you have triton 2.2 installed