Generative AI Is Coming to Phones Soon(cnet.com)
cnet.com
Generative AI Is Coming to Phones Soon
https://www.cnet.com/tech/mobile/generative-ai-is-coming-to-phones-next-year-thanks-to-qualcomm-chips/
https://www.cnet.com/tech/mobile/generative-ai-is-coming-to-phones-next-year-thanks-to-qualcomm-chips/
The page says they shrunk it by quantizing from FP32 to INT8.
What I can't tell... is there a demo app? Can this be run today on a Qualcomm based device?