How to run LLMs locally on mobile devices (with Gemma and On-Device AI tools)annjose.com 1 pointannjose1 year ago1 commentSaveHideCopy link On HNComments−incomingpain1yAny models that can run on a mobile device will likely be 8B or smaller, will have very noticable hallucination problems.
Comments
Any models that can run on a mobile device will likely be 8B or smaller, will have very noticable hallucination problems.