You are not wrong, but the practical reality of local hardware is to be batch-constrained in comparison with a multi-user inference cloud. You will never be able to compete cost effectively in your home lab with a cloud that has >100M end users streaming millions of inference requests per second across a gigantic fleet of machines.
Can I run a few inferences in parallel on my Mac Mini? Yes. But put 1,000 Mac Minis in a datacenter serving 1,000 copies of myself? That's going to be more efficient.
Here’s the two main reasons why local inference won’t compete any time soon with the cloud:
1. Most useful LLM work is done in parallel. A Mac Mini can run one LLM inference thread at a time. The cloud can spool up dozens and spread that inference across efficiently batched operations over a fleet of hardware.
2. Faster inference hardware such as the chips from Cerebras and Groq cannot be run locally. But the advantages of running >5x the token throughput per thread can’t be overstated. Add in the multi-threading advantage and it’s a knock-out punch for local LLMs.
Local inference has a role: if you’re working with extremely private matters or you want an uncapped model that will talk dirty or generate NSFW photos, local is the only option. I think Apple and others will continue to also run a lot of useful workloads locally such as text editing suggestions, speech to text, text to speech, and image manipulation. As local hardware improves, these capabilities will get better too.
But, for most LLM work, the cloud will continue to dominate for a long time to come, if not forever.
I disagree with this assessment. Theo is nerdy and, yes, he has a healthy ego. But, he provides insightful commentary on his channel and he works very hard to present what he believes is the truth. Compared to many YouTubers, whose content is vacuous, Theo is mostly the real deal.
It’s not about Iridium. It’s about Iridium’s customers and partnerships. RocketLab hopes to launch their own satellites presumably and then can sell significantly improved services to them, without having to build a customer base from scratch.
And anyone who has done an introductory course in VLSI design would know that capacitance (coupling) is something you usually want to get rid of. However, all kinds of amazing analog circuits have been developed over the decades that exploit coupling effects. So, their idea is not outlandish at all.
What they are trying to achieve is to demonstrate that the coupling approach works in a simulated physics environment (O(n^2) as you point out) so that they can then build CMOS circuits that create actual oscillators and then let the laws of physics do the computation. This is a very bold vision!
It's pretty great that you are providing the undistilled model on day 0. Here's a pro-tip: With Flux.2 Klein, someone created a turbo slider LoRA - basically a diff of the turbo 9B model vs. the undistilled 9B model. What's great about this LoRA is that you can sample using a heavier weighting of the undistilled weights during early sampling steps and then finish the sampling off with mostly the distilled weights. The result is a better "finish" (taking advantage of the distilled model's refinement for image quality) without sacrificing the undistilled model's greater ability to adhere to the prompt, because the undistilled model doesn't have to devote its weights so much to looking good.
This is a massive technical report for an open weights image gen model. As someone who has followed this space closely, it’s really cool to read about the behind-the-scenes experimentation and effort that went into the final product. I hope you will release some of the find tuning tools so the community can experiment with them as well and really push what the model’s capable of.
Good points. I would refine my comment: Canada has isolated examples of excellent megaproject execution, but lacks a system that reproduces that performance reliably. The nuclear announcement is credible only insofar as Canada can replicate the OPG/Bruce fleet-program model—stable authority and funding, standardized designs, repeat teams and accumulated learning—rather than its usual election-cycle, one-off megaproject model.
I dearly hope that we're not going to see that model again, but maybe that's likely.
You're right: you didn’t claim a lack of engineering competence. I introduced that distinction. Sorry. If the question is whether the Canadian society can build reliably, then governance and political instability count as part of its overall competence, not as external excuses.
I would agree with you that political volatility exists and stifles an otherwise decent country. It's very frustrating.
Canada is not an infrastructure “joke.” It is a country with some world-class delivery organizations operating inside a political system that too often destroys continuity. Relative to the G7, that makes it mediocre and volatile, not uniquely incompetent. And, in nuclear specifically, probably no worse positioned than its peers, though the ten-reactor rhetoric is substantially more ambitious than the underlying commitments at this time... (not surprising - it's a politician making an announcement, which is something of a prerequisite for making a "real plan" anyways).
As a Canadian, I think Canada’s primary hurdle is not a lack of engineering competence, but rather political volatility. Projects like Calgary’s Green Line often suffer from shifting scopes, fragmented authority, and delayed funding. Conversely, the recent Darlington nuclear plant refurbishment finished early and under budget. This proves that Canada can successfully execute megaprojects when planning is front-loaded and standardized.
Another comment I'd make is that the Carney government is only just a bit more than one year old. They're writing a whole lot of new policy. Will they succeed more than past governments? Who knows. But, at least they're spending the majority of their political capital trying to build stuff.
DeepSWE “feels” like the right benchmark in comparison to Artificial Analysis indices and other coding benchmarks. And by their metrics, GPT-5.5 is still king in token efficiency, speed, and overall intelligence per dollar.
Congratulations to the Intercom founders. This is a great result for them and the early backers of the company, for a product that I feel was executed brilliantly. We can criticize the usual enterprise-sales-y trajectory and enshittification that ensued after the brilliant opening moves, but at the end of the day, I think Fin reached a solid ending (no pun intended).
I'm not sure whether you're aware of how racist this comment may sound to many readers here on HN, but you're definitely echoing the sentiment of many Canadians who sense that "foreigners" are taking away their jobs - a concept that has been leveraged by conservative politicians to stoke distaste for the current government. There is indeed a lack of youth employment in Canada, and the TFWP may be somewhat to blame for that. But labelling it as a problem with regard to a single group of immigrants strikes me as unhelpful.
There is actually a sensible way to do recruit foreign workers to fill jobs that locals for some reason can't fill, and it's just a few miles up north...
Canada's Temporary Foreign Worker Program (TFWP) is not limited by annual caps or lotteries. You just apply (as a company) by filling in a few simple forms and posting a job in the "Canada Job Bank" for a period of time to demonstrate that you genuinely searched for locals to fill the role and couldn't find anyone suitable. I've hired many people through this program to fill a variety of roles over the years, and all of them eventually became citizens too. Once you're on Canadian soil as a TFW, moving toward permanent residency is not very difficult if you're a skilled worker with enough "points" (based on education, etc.).
Some argue (perhaps correctly) that the TFWP suppresses Canadian wages and productivity growth by flooding the labour market with cheap staff from poor countries. And there is likely some truth to that. But when I hear how many hoops my US colleagues have to jump through with lawyers and such to bring skilled employees in, it boggles my mind. If the Americans were to implement a more modern temporary foreign worker program similar to what Canada has, you'd have to imagine the US economy would boom like it never has.