Comment on GroqchatComments−coder5432yIs there any plan to show what this hardware can do for Mixtral-8x7B-Instruct? Based on the leaderboards[0], it is a better model than Llama2-70B, and I’m sure the T/s would be crazy high.[0]: https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboar...−tome2yYup, deploying Mixtral is a work in progress. Watch this space!
Comments
Is there any plan to show what this hardware can do for Mixtral-8x7B-Instruct? Based on the leaderboards[0], it is a better model than Llama2-70B, and I’m sure the T/s would be crazy high.
[0]: https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboar...
Yup, deploying Mixtral is a work in progress. Watch this space!