App to Run LLMs on Androidplay.google.com 1 pointValleZ2 years ago3 commentsSaveHideCopy link On HNComments−ValleZOP2yOne way to run LLM on android phone is to run ggerganov/llama.cpp in console like termux and it works quite well but is not super convenient. I was working on the app to make running on-device LLMs more user friendly, please try it out!−Zambyte2yCool project! Where is the source code for this?−ValleZOP2yIt's closed source for now, but it's based on llama.cpp and I'm planning to improve the included android example in the llama.cpp
Comments
One way to run LLM on android phone is to run ggerganov/llama.cpp in console like termux and it works quite well but is not super convenient. I was working on the app to make running on-device LLMs more user friendly, please try it out!
Cool project! Where is the source code for this?
It's closed source for now, but it's based on llama.cpp and I'm planning to improve the included android example in the llama.cpp