Meta and Qualcomm team up to run Llama 2 on phones(cnbc.com)
cnbc.com
Meta and Qualcomm team up to run Llama 2 on phones
https://www.cnbc.com/2023/07/18/meta-and-qualcomm-team-up-to-run-big-ai-models-on-phones.html
3 comments
> Llama 2, to run on Qualcomm chips on phones and PCs starting in 2024
Are they expecting for Llama 2 to still be relevant in 2024? Shouldn't it have been LLM or Llama (without the version).
Are they expecting for Llama 2 to still be relevant in 2024? Shouldn't it have been LLM or Llama (without the version).
Qualcomm wanted to run Stable Diffusion on phones as well, and IIRC they published a demo, but no one cared because it was a barebones demo.
MLC-LLM already runs LlamaV1 (and probably V2?) performantly on Android and iOS. But again, no one seems to care because its a relatively barebones demo.
Qualcomm needs to build and extensive feature set and probably a UI, otherwise no one is going to care about this implementation either.
MLC-LLM already runs LlamaV1 (and probably V2?) performantly on Android and iOS. But again, no one seems to care because its a relatively barebones demo.
Qualcomm needs to build and extensive feature set and probably a UI, otherwise no one is going to care about this implementation either.
I bet next up will be at the end of the year when Apple surely jumps into the ring with their version of on-device Siri, powered by their ML chips.