HackerTrans
TopNewTrendsCommentsPastAskShowJobs

tpurves

1,354 karmajoined 19 tahun yang lalu

Submissions

Ask HN: M5 MacBook Pro buyers, worth spending the $$$ to maybe run LLMs local?

11 points·by tpurves·3 bulan yang lalu·12 comments

Ask HN: Settings.json is an insane design choice for OpenClaw?

3 points·by tpurves·3 bulan yang lalu·0 comments

comments

tpurves
·kemarin dulu·discuss
this strategy worked to keep Ukraine alive, by enabling them to throw literally anything and everything they could obtain into the fight. And the system enabled rapid experimentation and evolution of what works. Also they didn't have enough of anything to equip all units equally or fully, so a market-like system of was also a way to triage short supply.

However the logistics costs of fragmentation are very real (relevant to the supply chain theme of this story). And now that Ukraine is producing the better part of 10 millions(!) of drones per year, they are shifting towards more standardized drone models to simplify logistics, achieve more economies of scale and also now to have the capacity to keep units equipped more evenly and reliably.
tpurves
·19 hari yang lalu·discuss
An unfortunate series of events that this thing ended up with these specs at 1,049.00. It was supposed to be cheap and cheerful. At first Steam took an opportunistic deal to buy up a bunch of near-obsolete-already chips from AMD to build a low-cost box around. Then years of delays and an explosion in DRAM and SSD prices and here we are.

4 year old chip design on an equivalently old process node, not that unlike nvidia selling 2-3 year old chips as the spark. Thanks to AI boom, consumer market really just getting the warmed-over leftovers here from AMD and NVDIA.
tpurves
·25 hari yang lalu·discuss
I do think local models are huge pending market opportunity for Apple. An M5 Ultra Mac Studio (if that exists) could be decent local AI machine, though so expensive as to stay niche. But by the M6/M7 generations and a recovery in DRAM affordability, the future could be interesting moment for them to deliver a compelling local AI platform that 'just works'. But I do think that a mini-pc that is easy to configure, can be always plugged-in, always on, higher power envelope than a laptop, but not obnoxiously loud and hot, is the right form-factor
tpurves
·bulan lalu·discuss
Not to mention quitting in droves because very many don't want to take these cases or otherwise to stand in court and explain why current admin is not bound by existing laws, court orders, the US constitution in general, or internationally recognized human rights etc.
tpurves
·2 bulan yang lalu·discuss
This has already happened. Home PC market is practically dead already due to memory, ssd and graphics card price inflation. Makers of components like PC cases and power supplies etc. are seeing demand down 30-40% year over year and this is going to put many suppliers out of business. NVDIA has stopped even listing gaming revenue on their earnings reports. Both NVDIA and AMD are not seriously interested in supplying the consumer GPU market anymore either.

The only hope left is really Apple, but even apple has conspicuously delayed the launch of M5-gen mac minis and mac studio. Mostly because even Apple can't source enough DRAM to fully supply all their product lines.
tpurves
·2 bulan yang lalu·discuss
China does not have sufficiently leading edge fab capabilities to fill DRAM demand.
tpurves
·2 bulan yang lalu·discuss
>> find a reliable place to sell it without getting ripped off by scammers.

This is a real problem and why I've just about given up on ebay or fb marketplace, esp for computers. If you are in Canada though sellit9.com is a great solution to having to deal with sketchy buyers.
tpurves
·2 bulan yang lalu·discuss
Well in that case, I predict you are going to be in luck!
tpurves
·2 bulan yang lalu·discuss
@Ademeure Where do you think the market will be by the time, say year from now, when Apple has rolled out it's M6 generation? Do you think one more process node and architecture revision will be enough yet to tip the balance that local LLM starts to go mainstream?
tpurves
·2 bulan yang lalu·discuss
What this article fails to mention is that there are also a record number of empty tankers routed to the US refineries right now, with the intention of shifting still-relatively cheap US oil products to overseas markets where the prices are already much higher and shortages have already hit. The effects of the Iran war on the US economy will really start to kick in over the next several months.
tpurves
·2 bulan yang lalu·discuss
I haven't been in a mcdonalds in decades because they have zero options for people with food allergies (I developed celiac midway through life).
tpurves
·2 bulan yang lalu·discuss
Nobody is using LLMs to make lending decisions. They are using LLMs to read, extract and audit the supporting documents that go into normal well-tested, compliant and rules-based underwriting systems. And firms A/B test against humans doing the same work. The outcomes your are looking for are metrics like delivering faster results back to customers, with fewer mistakes and less fraud, more compliant, than a comparable human-only process.
tpurves
·2 bulan yang lalu·discuss
Thanks for flagging this, I was literally seeing the same thing with protechts.net in my activity tab this morning as I was trying to understand why firefox was aggressively draining my battery.
tpurves
·2 bulan yang lalu·discuss
If it's not US and it's within a few percent of SOTA that might be good enough for a lot of people (eg Europeans)
tpurves
·3 bulan yang lalu·discuss
The conceptual problem is that we keep wanting to compare AI behavior to that of traditional computers. The proper comparison is comparing AI, and how we trust or delegate to it, to the concept of delegating to other humans or even to domestic animal. Employees can be trained and given very specific skills and guidelines but still have agency and non-deterministic behavior. A seeing eye dog, a pack mule or chariot horse will often, but not necessarily always do what you ask of them. We've only been delegating to deterministic programmable machines for very short part of human history. But ad human societies, we've been collectively delegating a lot of useful activities to non-perfectly-dependable agents (ie each other) for a very long time. As as humans we've gotten done more that a few notable things in the last several millennia with this method. However, humans as delegates or as delegators have also done a lot of horrific things at scale to, both by accident or by design. And meanwhile (gestures broadly around everywhere) maybe humans actually aren't doing such an optimal job of running and governing everything important in the world?

When compared to how human make a mess of things like in the real world, how high does the bar really need to be for trusting AI agents. Even far shy from perfect, AI could still be a step function improvement over trusting ourselves.
tpurves
·3 bulan yang lalu·discuss
The real 'hype' was that the oh-snap realization that Open AI would absolutely release a competitive model to Mythos within weeks of Anthropic announcing there's, and that Sam would not gate access to it. So the panic was that the cyber world had only a projected 2 weeks to harden all these new zero days before Sam would inevitably create open season for blackhats to discover and exploit a deluge of zero-days.
tpurves
·3 bulan yang lalu·discuss
Yep this was the moment to finally remember to cancel my cursor subscription. I find it unconscionable to do business with someone who would do business with Elon.
tpurves
·3 bulan yang lalu·discuss
Like with all new tech trends, it takes them a hot minute to catch up, but it's highly likely they will (eventually) release some killer platforms for local AI. The shared memory, high bandwidth and power-efficiency of their M chips is a near-ideal architecture. If/when they finally push out the M5-ultra, that could be round one (albeit still not at the best price/performace vs comparable cloud api tokens). A real mass-market killer device for local LLMs is still going to require some remediation of the global DRAM shortages, and maybe the M6/M7 generation.
tpurves
·3 bulan yang lalu·discuss
The insight here is, that in current warfare, quantity is the quality that matters. And with quantity, cost of replacement needs to be low, platforms expendable, cheap to maintain and resupply. It, and it's support infrastructure, need to not easily be detected and targeted by drones while on the ground. F35 is not these things. It's powerful but brittle, and like many US platforms, too much value packed into too few platforms. Not enough sustain in prolonged modern conflict. A one-punch military.
tpurves
·3 bulan yang lalu·discuss
This is such a dastardly psychological trick. Being slightly aswew really hard to fight the subconscious urge to reach out and 'fix' them. I almost want to rush out to a nearest McDonald's right now and buy one of these burgers so that I can make sure that it's buns are aligned properly....