Gemma locally on iOS, Android, web browsers, and GPUs with a single framework(old.reddit.com)
old.reddit.com
Gemma locally on iOS, Android, web browsers, and GPUs with a single framework
https://old.reddit.com/r/LocalLLaMA/comments/1aydopt/gemma_locally_on_ios_android_web_browsers_and/
1 comments
2b model running at 20tok/sec on iphone, nice potential for future applications