Comment on LLMLingua: Compressing Prompts for Faster InferencingComments−dmos622yExcuse the hijack: what are the most powerful language models one can run on any smartphone (without meaningful delay)?−intellectronica2yPhi-2 ( https://www.microsoft.com/en-us/research/blog/phi-2-the-surp... ) may be the best right now. Gemini Nano by Google DeepMind is a close second.
Comments
Excuse the hijack: what are the most powerful language models one can run on any smartphone (without meaningful delay)?
Phi-2 ( https://www.microsoft.com/en-us/research/blog/phi-2-the-surp... ) may be the best right now. Gemini Nano by Google DeepMind is a close second.