crowwork on Gemma locally on iOS, Android, web browsers, and GPUs with a single framework · Hackerly

Comment on Gemma locally on iOS, Android, web browsers, and GPUs with a single framework

2b model running at 20tok/sec on iphone, nice potential for future applications