HackerTrans
トップ新着トレンドコメント過去質問紹介求人

einsteinx2

714 カルマ登録 13 年前
https://github.com/einsteinx2

投稿

Stewart Cheifet, PBS host who chronicled the PC revolution, dies at 87

arstechnica.com
1 ポイント·投稿者 einsteinx2·6 か月前·2 コメント

コメント

einsteinx2
·5 時間前·議論
I was going to reply that I thought the Boeing 737 was also hands down the most popular commercial airplane model in current use, so of course it would have more high profile issues. Then I did a quick web search and apparently the Airbus A320 is actually more popular since 2025, otherwise they’re fairly close to even. Yet these things only seem to happen to Boeing.

So yeah, never mind, fair game to blame Boeing actually.
einsteinx2
·3 日前·議論
> and spent $165,000 of tokens on the most advanced coding LLM anyone has access to.

After having used 2 full weeks of 20x Max plan tokens on Fable over the weekend (coding all day Saturday and Sunday on a non-trivial project, tasks across full stack, mix of adding features, reviewing code, and fixing bugs), I’m confident if he’d spent $165,000 in Opus tokens the port would have gone more or less just as well (and probably for less than $165,000). Especially so with the system they set up with all the custom workflows, adversarial reviews, extensive test coverage, etc.

But I get your point is probably more about Jarred’s experience level and the high cost than the specific model used other than it being SOTA. I’m just being pedantic and feeling a bit disappointed with Fable’s real world performance after all the hype.

> I expect if he'd spent $165,000 running Fable against the Zig version he could have got a 5% performance improvement, too.

Totally agree and in fact I’m sure it could be done with significantly less cost even if they stuck with Fable instead of Opus which I’m sure could also do it.
einsteinx2
·4 日前·議論
> I also did an N=1 test with the same prompt doing a large non-trivial change to the codebase (migrating from Sqlite3 to Postgres) with both Fable Medium and Opus Ultracode, then had a new Fable session compare the two PRs...it decided Opus’s was much better! I can link a Gist with the review if anyone is interested, but I can't share the code as it's a private repo. I really figured Fable would bias to favor its own code, but I guess not. And Opus costed less (in tokens and subscription limits) and took roughly the same time (though you can’t really measure time since it depends entirely on how many GPUs Anthropic allocates at that moment which constantly fluctuates due to usage, plus Fable seemed to have been getting way more allocation than Opus during this test period as Opus was running unusually slow all weekend while Fable was ripping though tokens).

Haha I just gave the exact same prompt to Opus Ultracode and it thought Fable’s was better.

Obviously this isn’t the most scientific test due to LLM non determinism, and I still need to manually review both to make my own decision, but the fact at least they seem to basically be a wash is pretty telling about how much of an improvement Fable is when you actually compare them as close to apples to apples as possible (aka similar actual effort/token spend/sub agent activity)
einsteinx2
·5 日前·議論
This was my exact takeaway after my experience using it all weekend, and I used it a lot working on a non-trivial personal project (full stack with a Golang backend with multiple services and a React/TS frontend, not quite greenfield but still early-ish in development).

My weekly quota resets Sunday morning, so Saturday morning I upgraded to a 20x Max plan which also reset my quota. I burned an entire week of Fable credits on Saturday, my quota reset again, then I burned another week of Fable credits on Sunday. Both days were a mix of building features, reviewing code, fixing bugs, adding tests, etc, so a decent mix of real world usage.

The main takeaway for me is that while Fable is definitely a better model, the improvements from the model itself feel like maybe 10%, like this could have easily been Opus 5 or even 4.9 without all the marketing theater around Mythos and no one would have thought anything of it. The rest of the improvements came from harness/system prompt and effort level changes so that Fable uses significantly more tokens/effort/sub-agents at lower levels than Opus does (which of course is entirely controlled by Anthropic at the harness level and doesn't really have anything to do with the model itself).

In my estimation based on those 2 days of work (or two weeks of work depending on how you look at it), Fable Medium is somewhere above Opus Ultracode in token and sub-agent usage on any non-trivial task (Opus Ultracode uses workflows more than sub-agents, but it's a similar idea). Fable Medium will quickly spawn 6 agents in parallel, each quickly using 150-250k tokens, then will use 300-500k or more tokens in its own context. Fable High uses even more as it seems to default to 8 sub-agents instead of 6 and more tokens in its own context). I didn't dare try Extra, Max, or god forbid Ultracode as I didn't want to burn all my tokens on one prompt. Of course this is situational, it won't fan out so many for smaller tasks, but the whole point was testing larger tasks that I previously would have used Opus Extra/Max/Utracode on.

I really don't like how Anthropic is obfuscating their model performance by playing with effort levels. They did the same thing between Opus 4.5 and 4.8 to show a bigger performance gain for each point release than they really had (especially after 4.6 IIRC), so you can't even compare the same model apples to apples let alone a new model. Obviously they do it so they can market big improvements with new releases, but its pretty clear we're at the top of the S curve on model development at this point and are now brute forcing improvements via higher token usage (I mean Opus 4.5 came out almost a year ago, and the latest Opus and now Fable models are only marginally better while using way more tokens/cost...same on the OpenAI side with GPT 5 from what I can tell though I haven't used Codex much I have used the GPT model APIs a lot).

I also did an N=1 test with the same prompt doing a large non-trivial change to the codebase (migrating from Sqlite3 to Postgres) with both Fable Medium and Opus Ultracode, then had a new Fable session compare the two PRs...it decided Opus’s was much better! I can link a Gist with the review if anyone is interested, but I can't share the code as it's a private repo. I really figured Fable would bias to favor its own code, but I guess not. And Opus costed less (in tokens and subscription limits) and took roughly the same time (though you can’t really measure time since it depends entirely on how many GPUs Anthropic allocates at that moment which constantly fluctuates due to usage, plus Fable seemed to have been getting way more allocation than Opus during this test period as Opus was running unusually slow all weekend while Fable was ripping though tokens).

Also on a different long running review task using Fable High in Auto mode (exactly the kind of use case Anthropic promotes for Fable) where it fanned out a ton of sub-agents then collated and reviewed all of their fixes it completely lost the plot (while burning something like 20% of an entire week's Fable tokens in the process over like 1-2 hours). Its PR ended up having a broken Frontend test, it incorrectly thought it couldn't run the Playwright E2E tests (different from the Frontend CI) in the cloud environment due to a Docker dependency they explicitly don't have, and when attempting to get it to fix its issues it introduced new ones and overlooked others. The usual LLM failure case for long running tasks, no different from Opus or any other model. I had to have its PR re-reviewed in a new Fable Medium session to fix it up, which it did fairly easily (I'm sure Opus could have done just as well for much cheaper).

That test and that review session definitely reduced my FOMO a lot, on top of just my general experience with Fable Medium doing all kinds of tasks. They're clearly brute forcing like 90% of the perceived improvements in real world usage (and I'm sorry but 1-shotting toy examples where it seems to do much better than Opus is not real world usage).

Since most of the improvements basically just boil down to "every effort level is Ultracode, but much more expensive and possibly worse results"...I'm just going to use Opus on Ultracode for those types of tasks and keep using Opus's lower effort levels for smaller tasks. Once they eventually add Fable back to subscription plans I might use it sometimes, but from my experience this weekend the improvements are absolutely not in line with the cost increase and I'm not willing to burn a whole week's tokens in a day just to use it when I can use Opus all week without hitting my limit.

Oh and one interesting observation, I never got kicked back to Opus by the security guardrails as far as I know (a friend who was getting kicked out a lot confirmed they do inform you and I never had that happen). I was even doing a lot of reviews for code correctness and bug fixes which I thought might trigger the protections, but never did, though I never explicitly prompted it to look for security issues or vulns.
einsteinx2
·6 日前·議論
> They do this because engaging in a common taboo unites the group extremely strongly, and these behaviors are the ultimate taboo.

This last sentence immediately made me think of Epstein’s island and the “ultimate taboo” they were engaging in there.
einsteinx2
·8 日前·議論
Honestly I think it’s just a Microsoft and Google problem. Microsoft has been terrible at branding for as long as I can remember, and Google seems like they’ve been slowly turning into Microsoft over the years in more ways than just poor product naming.
einsteinx2
·14 日前·議論
I don’t know it sounds a lot more likely to me that piracy will just come back in popularity in a big way instead. Why pay inflated prices for old machines that will certainly break and old discs when you can just download a DRM free copy easily for free?

When streaming first took off piracy hit all time lows, but it’s already been coming back in a big way and I’m sure will only continue to do so going forward as things like this keep happening and streaming keeps getting more expensive and fragmented.
einsteinx2
·15 日前·議論
No one needs anything, but can and do I use more than 1Gbps from my laptop? Of course. 1Gbps is only ~125MB/sec transfer speed. When I’m copying large files to and from my home NAS, I often want more speed than that so a while ago I picked up a 2.5g adapter, later 5g, and now finally with these new chips a 10g adapter.

Same for my SFF PC which only came with 2.5g onboard and no extra slots because ITX and can now do 10g via the same USB adapter which is great.
einsteinx2
·16 日前·議論
Speaking of model killers, can they do “wine glass completely full to the top” yet? That‘s the one I used to show people but I haven’t tried it in a while.
einsteinx2
·17 日前·議論
When the comparison is literally every other cloud provider who all charge by usage only, then anything more than $0.00 is in my opinion too much to ask for.

I’ve been using cloud services in one way or another from different providers (including EU based like Hetzner) and never seen this before. It’s always been pay for what you use and nothing more, which is kind of the whole pitch of cloud services.
einsteinx2
·21 日前·議論
I was just mentioning this in another comment earlier today, but Claude Opus 4.8 (that version specifically) uses the word “genuinely” on so many of its responses that I’ve started using it often when speaking when I didn’t before. Nothing wrong with the word itself, just a frustrating reminder that using these tools all day for work (and then on top of that some nights and weekends for personal projects) is literally changing how I speak and presumably think…
einsteinx2
·21 日前·議論
That and I’m not sure why they rebooted the server every time instead of just changing the flags…
einsteinx2
·21 日前·議論
As soon as I saw the phrase “belt-and-suspenders” I immediately thought Claude, as it uses it constantly, but maybe so does ChatGPT.
einsteinx2
·21 日前·議論
Or “belt-and-suspenders”.

Was already getting lots of AI generated vibes from the article before that, but I’ve seen Claude constantly use that phrase and no real person ever in my life (though I guess some people must have or LLMs wouldn’t have learned it).

It’s the most annoying thing about reading anything LLM related. I genuinely (ugh that’s a term I’ve picked up from using Opus 4.8 every day for work as it constantly says it and now so do I and I can’t stop) want to learn more about the topic but it’s painful to read most posts about it.

The people really into LLMs, surprise!, have a tendency to also LLM generate their writing about LLMs. This would be fine if they used that as a starting point then edited it for brevity (LLMs are consistently overly verbose for some reason, this post was like twice as long as it needed to be, though I guess you could argue the same about my comment haha), correctness, and tone…but they usually don’t.

Then I make it halfway through the article and wonder if I can trust any of it at all.
einsteinx2
·21 日前·議論
That’s a perspective on the AUR that I hadn’t really seen before from Arch advocates, in my (admittedly hazy memory) it’s usually mentioned in the sense of “Arch is great because you always get the latest packages in the official repos and basically anything you possibly need you can just install from the AUR”. If you’re actually using it just as a reference guide essentially then it seems like there’s some value there.

However, I’ll push back a bit from my perspective as a Debian Stable user. I would consider even the official Arch repositories to be dangerous just like I consider Debian Sid’s repos to be dangerous (packages are too new and not sufficiently vetted). Then regarding installing packages not available in the main Debian repos, I’ve never really had any issues installing them either as there is always either an official developer run apt repo I can add, or an official deb package, or it just builds directly from official source without tweaks. So I’ve honestly never felt like I was missing “a crowdsourced set of people’s tips and tricks for installing stuff” on Debian as I’ve just never needed one.

I do realize that installing the latest packages directly from a developer’s repo or latest deb package or source is as dangerous as the Debian Sid or Arch official repos for the same reason (too new, not vetted), but the difference is those are only a tiny portion of the packages installed on my system (like a percent of a percent, maybe a half dozen packages out of hundreds). If I ran Sid or Arch, it would be 100% of the packages on my system which is an attack surface orders of magnitude larger.

EDIT: It did just occur to me after posting this reply that I use Homebrew pretty extensively as a package manager on macOS and its official repos are equivalent to Sid/Arch official repos, so I may be a bit of a hypocrite here :P
einsteinx2
·21 日前·議論
No because there’s no way to handle an open submission repository at all. It’s impossible by design since anyone can submit packages to it.

I would never use anything equivalent to AUR on any distro due to the obvious security implications. That’s been my position for as long as I have known about Arch. I never understood Arch users using the AUR as a selling point for the distro.

Then again I live in the opposite end of the spectrum where I run only Debian Stable on my Linux desktop as well as my servers, where packages make it through Sid and Testing before getting to Stable and I can be relatively sure any supply chain attacks have been caught by then (like xz for example which was caught before it left Sid).

For those unfamiliar with Debian, Sid is basically a rolling release similar to using Arch with the official repositories (which is already dangerous without even touching the AUR), then packages move to Testing, then later eventually make it to Stable.
einsteinx2
·先月·議論
Yeah I was gonna say I use Colima with Apple’s virtualization framework (it’s not the default for some reason but it’s a single command line flag), and found it works better than QEMU (better performance and resolved some bugs I was running into with the Supabase docker stack)
einsteinx2
·先月·議論
I did some searching. I assume you mean “Relics: Einstein's Brain (1994)”? If so, it doesn’t look like it was ever released on anything but VHS, so I only found a TV recording and a VHS recording.
einsteinx2
·先月·議論
What movie was it? There’s a good chance I can find it.

If you’re in Reddit, there’s also a subreddit dedicated specifically to this kind of thing (requests for stuff that is no longer available) called /r/DHExchange
einsteinx2
·先月·議論
That iMac should easily run Linux, why not install it? Also I don’t know what else to call hardware that’s still working great 14 years later except for longevity…