Locally-run LLMs are very cool, but I think we have some way to go for smartphone performance to make datacenter-run (or beefy personal workstation for privacy!) ones obsolete.
Until then, I also really like the idea of making chatbots accessible via instant messengers. I find myself using the one in WhatsApp quite a lot these days, just because it's conveniently available on multiple platforms (with my history synchronized) and I can tag it in when chatting with friends. It also works on flights with zero-rated messaging.
Comments
Can your bot be run on mobile?
Can Claude?
Locally-run LLMs are very cool, but I think we have some way to go for smartphone performance to make datacenter-run (or beefy personal workstation for privacy!) ones obsolete.
Until then, I also really like the idea of making chatbots accessible via instant messengers. I find myself using the one in WhatsApp quite a lot these days, just because it's conveniently available on multiple platforms (with my history synchronized) and I can tag it in when chatting with friends. It also works on flights with zero-rated messaging.
Using Poe.com and their mobile apps it can.
The LLM there runs on your phone?
No, Poe uses APIs to the foundation model providers running inference in the cloud.
You can access it via your normal Matrix client, like the Element app for iOS or Android.