Comment on Zamba2-7BparentComments−gbickford1yIf you look in the `config.json`[1] it shows `Zamba2ForCausalLM`. You can use a version of the transformers library to do inference that supports that.The model card states that you have to use their fork of transformers.[2]1. https://huggingface.co/Zyphra/Zamba2-7B-Instruct/blob/main/c...2. https://huggingface.co/Zyphra/Zamba2-7B-Instruct#prerequisit...
Comments
If you look in the `config.json`[1] it shows `Zamba2ForCausalLM`. You can use a version of the transformers library to do inference that supports that.
The model card states that you have to use their fork of transformers.[2]
1. https://huggingface.co/Zyphra/Zamba2-7B-Instruct/blob/main/c...
2. https://huggingface.co/Zyphra/Zamba2-7B-Instruct#prerequisit...