Right now we have a LOT of band aids. You want to optimize compute and thinking to a particular problem, sort of like we do. Yes you cannot perfectly predict this but you can do decently well and save a ton of tokens at the cost of this band aid being sort of leaky and gross.
But the larger problem is sound, and the answer is something jointly optimized (idk how they do the routing) but it’s hard to shoehorn it into the current paradigm.
Hey I totally agree I do not want a teleoperator looking into my house, it’s just so deliciously tempting to get in home on policy data. Not sure the reason why they are super interested in home environments vs business or public spaces.
Totally agree but the idea is this gives you a teleoperation environment that is truly on policy and not some artificial lab. The idea is that these robots, like those Amazon stores, are predominantly just controlled by actual humans.
I think the problem is whether you're for or against local models, the training strategies etc are roughly the same.
> I think the last month has resulted in a lot of people saying “f u I would rather fail in life than serve you”.
I agree a lot of people are saying this and doing this but this won't last long. People do not want to suffer or fall behind their peers. At some point not using AI for anything will not be a feasible option. Unless you operate from an incredibly uncommon and privileged financial position, you don't really even have a choice.
I agree with everything you're saying. And I would also agree if you can run your business adequately on OSS models you should absolutely do that for exactly the reasons you say. All I mean is: frontier models will always have their place and I don't see a way for OSS to ever change that picture. I also worry that the economics that makes meaningful open weights model development possible may break someday but I don't really see a mechanism for this at this point.
I don't actually have a use case in mind where you would _need_ or get a substantial competitive advantage of the absolute frontier in some sort of workflow or whatever load bearing DAG there is for your business. But if there are cases like this, that will suck.
> Marketing is just an arms race. It is ok to limit how manipulative and harmful it is and force companies to compete on something else.
I agree with this, and I think you are right about a lot of this being really just not market-relevant factors that are driving a lot of the downsides here. All of these should be regulated, and even the ones where regulating will have impact to markets and consumers.
And I agree -- effective advertising targeting necessitates "reward hacking" in that I can get you to buy something if I prey on your insecurities or otherwise manipulate you in a way that goes beyond "oh I know what watwut would love as a birthday gift".
But you really should be aware that effective advertising really does disproportionately benefit smaller businesses and this is generally a Good Thing. Really my only point here is that there is a baby in this bathwater and we should be careful.
> We have observed consistent scalings of language model log-likelihood loss with non-embedding parameter count N, dataset size D, and optimized training computation Cmin, as encapsulated in Equations (1.5) and (1.6). Conversely, we find very weak dependence on many architectural and optimization hyperparameters. Since scalings with N,D,Cmin are power-laws, there are diminishing returns with increasing scale.
This is why, because this completely misses the point. Every power law has diminishing marginal returns, that is by construction. The point is that they diminish predictably and smoothly across seven orders of magnitude of compute. There is no plateau anywhere in the observed range, and in fact larger models more sample efficient than expected.
You can't just cherry pick one sentence containing the phrase "diminishing returns" and ignore the actual paper. The whole reason the labs spent the GDP of a small country on GPUs is that the curve is boring and reliable. No one just was like "oops we missed that line in the Kaplan paper, shit".
Lots of arguments as to why things may slow down or hit fundamental limits requiring a paradigm shift. But at several points in the past 5 years many major players have assumed this to be the case and have been continually proven wrong. Not to mention the plethora of socioeconomic horrors coming out of this Pandora's box, which I believe to be a large colocated B300 compute cluster somewhere in the midwest.
A point that would have been consistent with Kaplan was them finding alpha ~ 0.05 on compute means halving the reducible loss is a million times more expensive. But this was invalidated by Chinchilla who found it to be ~0.36 (100x more compute, not 1million). And loss has a non-linear relationship with capabilities, but roughly halving pretraining loss is ~doubling the METR task horizon. We also haven't factored in something incredibly important which is: algorithmic / architectural / training pipeline gains. These are substantial too!
They are still a few years away from parity. It's not that they _cannot_ train frontier models its that it costs 6x as much roughly, and thats ignoring the headaches and extra hoops they need to gather that compute. That is the entire point of export controls. Slow them down, make R&D more painful. The whole picture -- Chinese research now being best in the world for compute-efficient AI development, China aggressively pursuing independence in compute capabilities -- are all perfectly predictable and do not invalidate the point that export controls are doing their job.
Regardless of any export controls (or really anything else) China would be aggressively ramping up chip production capabilities as fast as they possibly could. Export controls maybe help slightly here but it's worth it. China will succeed too, but it takes time. China has been pursuing this for decades.
> Let's face it - all bans were dumb.
Predictably, this is oversimplifying.
> They just gave China the legal (per WTO rules) justification to start producing everything domestically.
It just doesn't matter, reliance on chips from an adversary is an untenable place to be. They don't need any legal excuses.
> he bans work as a reverse tariff, as a protectionist measure that actually protects your competitor.
Again untrue -- tariffs are devastating economically but BOTH the US and China want independence from another, it's just a very painful cost economically to do the divorce. It's far less efficient and horrifies economists but geopolitics is multifaceted.
> If China did those, others could bring China to court at the WTO. But the US did that, so nobody can sue China.
Hmmmmm would this really work? Would this have any meaningful impact whatsoever on their strategic initiatives? I highly doubt that.
by your username I assume you are yourself one of the droids you're looking for lol.
But also I think people forget: this is not cut and dried. This is not simple. This is not just "these companies are evil and should be stopped". It is: there is a market pressure to do these things. "I enjoy the product and use it a lot" and "I am addicted" is blurry and market pressure is not going to recognize that limit because it does not care about human suffering unless that suffering meaningfully impacts the bottom line.
If these companies hit regulations that effectively cap their advertising revenue per user (i.e. the "addictiveness"), they are dead. That may be totally fine, and I'm sure majority of people would rejoice hearing this. But remember: advertising dollars are earned, especially at tech company scale, by the effectiveness of the targeting to get get more $ / DAU since DAU cannot grow beyond the Earth's population and that is the scale that these companies have already achieved.
If you cap advertising dollars, you cap advertising effectiveness. You cap the ability for small companies to connect quickly with prospective customers without being locked out because they have to spend too much to find them. Yes you also cap scammers and other nefarious actors too, but thats arguably a different issue. The impact of reducing advertising effectiveness is disproportionately concentrated on small business where cheap and effective advertising is so important.
My hope is that there is a way to do both and I don't have to be constantly horrified when I look at my screen time hours.
This makes sense but I am not comfortable with the open source picture either. It depends on the use case and long term strategy. If you're handling customer support tickets or something, beyond some capability I can't imagine the ROI would be worth needing the absolute frontier. You are then in a wonderfully lovely place: absolutely full control over the model and inference stack (if you want).
But
- Plenty of businesses are stuck between a rock and a hard place: make 3p models load bearing, or sacrifice performance to the competitors that are willing to swallow that risk
- I just cannot imagine a viable equilibrium where OSS models compete on capabilities with the frontier without a hidden payer and shaky economics. Quant funds, some sovereign AI effort, cloud business, sanctioned distilled frontier models; all of these are demonstrably viable vehicles for OSS development. But the optimal position for these purposes is not to be the best, it's to be good enough (which I think is the position they find themselves in). I can imagine temporary points where open models pull ahead but not sustainably.
I agree there are many many use cases where the optimal choice is to reach for open weight models (I assume yours is one of them).
But the economics of frontier model development necessitates that these models are behind and thats a problem for other cases.
> Nope. If China were not banned from US-controlled chips, it would be importing chips at much higher prices, therefore getting less bang for its buck while strengthening competitors with its money in the process.
Nowhere near the value of having access to chips, at any cost. They have extremely deep pockets. They already pay 6x the cost per FLOP.
> Instead, the US banned China from chips and lithography machines, giving China the legal excuse to start producing them domestically without violating WTO rules. Now China produces cheap chips and uses them with cheap electricity.
You think without export restrictions China wouldn't be doing the exact same thing? China needs absolutely zero legal excuse. I mean sure they have compute available on grey market / domestically but at 6x the cost per FLOP. Access to NVIDIA chips would make it dramatically cheaper for them. Yes you get chip income but that is not even close to what you lose. The strategy is doing what it was always supposed to do: slow them down, bleed their resources to force them to spin their wheels catching up. China is doing a great job with this but they are fundamentally constrained by these export controls.
You are right that this greases the wheels, they are further along than they would have been without export restrictions, but they are still delayed even with the reduced friction. The alternative is that they move slightly slower _while having the same compute infrastructure available_ and at dramatically lower energy costs. That is a far worse position for the US to be in.
> This was a dumb move by the US. Brought upon it by dumbf-ck aristocratic elites who grew up in isolated mansions and then received law degrees, with absolutely no understanding of technology and technology ecosystems. They thought they'd just make the rules and everybody would have to obey. It turns out in technology, they don't have to...
I think this is too cynical. Neither one of us is in the room to actually observe the real decision making, but export restrictions as a strategy are not some "dumbf-ck aristocratic elite" thing. They are perfectly rational from a strategic standpoint and arguably doing what they're supposed to do.
That is exactly the scenario that I believe and invest in. I peg trouble in Taiwan in the next 2 years at about 30%, which is waaaay higher than is priced into the market right now. If you think intel has gone up in price a lot now, it will absolutely skyrocket if TSMC fabs suddenly disappear. After adjusting to a domestic fab pipeline, we will have built up again an industry with a good talent pool (which we don't have now, Arizona TSMC fab needed to ship people in from Taiwan). At that point, why go back to a TSMC model? Hence we will have a booming domestic production pipeline, though still with complex international dependencies for various components.
Oh no Chinas chip manufacturing efforts have a long and rocky history, they would be pursuing a sovereign stack no matter what.
The tradeoff is worth it. They’re even publishing papers which blows me away — their efficiency gains quickly become incorporated into frontier models because they are open sourcing them. They would be aggressively pursuing the same chip pipeline strategy as they are today.
US is lagging in efficiency work because the ROI is better elsewhere for us. We have the same tier of talent, once the script flips so can the research.
The Jensen argument that "oh we get them hooked on our technology and that will actually be better" is bullshit -- they would do the exact same thing they're doing now of building their own supply chains and compute power but be able to accelerate their progress in the meantime with US chips. It is worse in every way to sell them SOTA chips (or even previous generation chips).
Of course they have ways around this -- you can get black market GPUs and also API costs are SUPER cheap there -- they hack the subscription model, bundle a bunch of user accounts, and route API requests through them.
And yes they are getting to parity with US technology and will get there in a few years, they have decent chips but still not the quality of NVIDIA.
Exactly -- the hope for US strategy is that you can slow them down a lot but not forever. That slowing them down is in itself enough to keep a strategic advantage over them both in terms of economic growth and offensive capabilities both in terms of cyber attacks, intelligence and things like drones, etc.
Yes but in an equilibrium steady state, compute and data advantages are all you need to first order. China does not yet have a compute advantage. RL is indeed the magic sauce for coding agents but the bottleneck for how much progress you can make, for both the US and China, is compute. The US at least for the next few years has a clear advantage here.
Definitely hasn’t backfired. Exporting would have just sped up their progress. Instead they had to get clever and lean into the bottleneck which for them, now, is compute efficiency. This is temporary and they’ll figure out competitive chip design and production but not for several more years. It’s incredibly hard to match the quality of NVidia and TSMC, as China has found throughout years of trying.
But the larger problem is sound, and the answer is something jointly optimized (idk how they do the routing) but it’s hard to shoehorn it into the current paradigm.