The iPhone 17 Pro can run LLMs fast(old.reddit.com)
old.reddit.com
The iPhone 17 Pro can run LLMs fast
https://old.reddit.com/r/LocalLLaMA/comments/1nlu3cd/the_iphone_17_pro_can_run_llms_fast/
6 comments
I'm super excited for the future of local LLMs! By 2030 an 8b model may be as powerful as the top models are today for nearly all consumer usage.
Look, the tech is cool and exciting and all. But when smartphones started catching on, there were concerns about having actual tracking devices with all these sensors always-on internet connectivity and many of those concerns turned out to be far worse.
LLMs locally on smart devices with access to all the sensors and doing RAG over the internet and all that will also have some dire consequences.
Point being, it's humans that are the problem, that abuse tech. We need lots of laws and regulation yesterday. I don't know what else could be done beyond the destruction of democracy and post-WW2 peace but I'm sure there are people plotting how to abuse this already and no one to stop them.
I'll give you an example, should local LLMs be used to psychologically influence a person's behavior (advertisers would love that!). How about to measure and classify a person for their credit worthiness, job worthiness, potential to support or oppose a political opponent? I'm fairly certain there are people already working on how to influence elections or destabilize democracies with this already.
LLMs aren't new, but their access to phones is. and app makers can say "we're not tracking you" so long as they don't send what they collect off-device. they can just use the LLM to collect indirect information and use personal information to suggest and influence people.
We still don't have nation-wide (good) privacy laws in the US. GDPR and EU privacy laws exist but they're at least a decade behind the tech out there and nowhere near effective at targeting or deterring violators beyond some penalties against big tech.
LLMs locally on smart devices with access to all the sensors and doing RAG over the internet and all that will also have some dire consequences.
Point being, it's humans that are the problem, that abuse tech. We need lots of laws and regulation yesterday. I don't know what else could be done beyond the destruction of democracy and post-WW2 peace but I'm sure there are people plotting how to abuse this already and no one to stop them.
I'll give you an example, should local LLMs be used to psychologically influence a person's behavior (advertisers would love that!). How about to measure and classify a person for their credit worthiness, job worthiness, potential to support or oppose a political opponent? I'm fairly certain there are people already working on how to influence elections or destabilize democracies with this already.
LLMs aren't new, but their access to phones is. and app makers can say "we're not tracking you" so long as they don't send what they collect off-device. they can just use the LLM to collect indirect information and use personal information to suggest and influence people.
We still don't have nation-wide (good) privacy laws in the US. GDPR and EU privacy laws exist but they're at least a decade behind the tech out there and nowhere near effective at targeting or deterring violators beyond some penalties against big tech.
While I agree with what you're saying here, the concern doesn't seem like it is worse when the model is running locally as compared to storing your data in the cloud and running all of the ai models remotely. It's ultimately the same outcome, perhaps local models offer a bit more privacy even if there are other concerns as you've mentioned.
It doesn't seem like there is any hope of stopping this, the cat is out of the bag.
It doesn't seem like there is any hope of stopping this, the cat is out of the bag.
with local models, you don't have to take the personal data off device, thus bypassing every privacy law. there is also a cost to collecting enormous amounts of data from telemetry sources, if they don't leave the device, that cost is 0 now. imagine recording the audio of every user you have with 1M+ MAU and shipping that to a cloud, storing and processing it,etc... now you don't have to do that. it's huge game changer.
This is like how we had flip phones with browsers and apps before the iphone..and then the iphone changed the game.
This is like how we had flip phones with browsers and apps before the iphone..and then the iphone changed the game.
Looks just like as fast as 16
https://www.macrumors.com/2025/08/13/apple-smart-home-hub-20...
I wonder if this new Siri would be limited to Pro devices. It would be strange for Apple to release a new feature exclusive for Pro devices that wasn’t mentioned in the September iPhone event.