HackerLangs
TopNewTrendsCommentsPastAskShowJobs

trunnell

no profile record

comments

trunnell
·9 วันที่ผ่านมา·discuss
Their post detailing the timeline and their actions since reinforce my belief that Anthropic is among the most trustworthy AI companies.

https://www.anthropic.com/news/redeploying-fable-5
trunnell
·9 วันที่ผ่านมา·discuss
Blame Amazon and the White House
trunnell
·10 วันที่ผ่านมา·discuss
There is no reason to have less trust in Anthropic. It's not clear they did anything wrong. It's more likely the White House simply tied itself in knots, consistent with the last year and a half of chaos from them.
trunnell
·10 วันที่ผ่านมา·discuss
Hooray! Glad everyone came to their senses and we can all get on with business.

I bet it'll continue to be messy at the frontier for the foreseeable future as society gradually wakes up to the consequences of strong AI.
trunnell
·17 วันที่ผ่านมา·discuss
Maybe you mean that an expert will use more specific language which in turn triggers the model to give a response that more closely matches the "expert distribution"

Anthropic published a study showing that Claude does more work for the expert user, and experts have a higher rate of "successful sessions" than novices.

https://www.anthropic.com/research/claude-code-expertise
trunnell
·22 วันที่ผ่านมา·discuss
> honest angle is that the industry [felt] exposed by the residual risk [and] have a months-long bugfixing backlog exposed by Glasswing

Two problems with this theory.

1. Amazon complaining to the White House wouldn't have been the opening salvo. Amazon and Anthropic would find it much easier to talk to each other than go through the White House. We'd need evidence that Amazon (and probably others) already asked Anthropic to not release a Mythos-class model but Anthropic released it anyway. Are they on record saying this?

2. The jailbreak Amazon found needs to be real. Maybe the White House staffers are not AI experts and they don't really understand what a jailbreak is... but it's much harder to make that claim about Andy Jassy. For the jailbreak to be the real reason for the export control order, the jailbreak would need to be significant and cause material harm to Amazon. Then Jassy might pass it along to the White House assuming he already was refused by Dario.

But there is no evidence the jailbreak was real. There is one story that it amounted to a request, "fix this code." In any case, Anthropic is on record saying the so-called jailbreak didn't enable any vulnerability work that couldn't already be done by other models.
trunnell
·22 วันที่ผ่านมา·discuss
Sure they exist but they're rare, difficult to identify and hire, and take years to train. Mythos/Fable is available on tap.
trunnell
·23 วันที่ผ่านมา·discuss
What an amazing achievement by America's adversaries.

The Trump administration lists Anthropic as a security risk and kneecaps its best model, despite the fact that compared to the other frontier US labs Anthropic is more transparent, more safety-oriented, frequently honest to a fault, and is clearly acting with patriotic intent.

Meanwhile, the same administration is hesitating to counter certain Chinese companies' efforts of industrial-scale theft and sabotage due to a fear of angering the CCP!

This administration has it exactly backwards. 4.5 months until election day, 7 months until the next Congress is sworn in.
trunnell
·23 วันที่ผ่านมา·discuss
Why?
trunnell
·28 วันที่ผ่านมา·discuss
> They ultimately got what they wanted.

No, it's not what they wanted. As it says in your quote, they wanted "a statutory process that is transparent, fair, clear, and grounded in technical facts. This action does not adhere to those principles."
trunnell
·29 วันที่ผ่านมา·discuss
Oh, I agree distillation isn't stealing "outright" as in it's not theft of 100% of the model. But there's a reason they're doing it. I didn't say anything about Chinese labs innovating -- obviously they are.

What accounts for the difference between your attitude that distillation is no big deal, "common practice," yet Anthropic sees as it as a huge threat?
trunnell
·29 วันที่ผ่านมา·discuss
"Anthropic accused Chinese firms of 'industrial-scale distillation attacks' on its AI models."

"Distillation involves training less capable models on more advanced ones’ output, and can be used illicitly to acquire powerful capabilities cheaply. The AI startup accused China’s DeepSeek, MiniMax, and Moonshot of generating 'over 16 million exchanges with Claude through approximately 24,000 fraudulent accounts,'"

https://www.semafor.com/article/02/24/2026/anthropic-accuses...

After reading their posts and watching interviews with Dario it's abundantly clear that they view Chinese-lab distillation of US frontier models as a threat to US national security. You can argue with them about whether that is true, but not whether distillation is real.
trunnell
·29 วันที่ผ่านมา·discuss
To prevent their models from doing harm in dual-use contexts including CBRN or by accelerating research in authoritarian-backed AI labs.
trunnell
·29 วันที่ผ่านมา·discuss
I'll defend Anthropic.

They are clear about the reasons for guardrails: prevent their models from doing harm in dual-use contexts including CBRN or by accelerating research in authoritarian-backed AI labs.

What is the critique against that? It seems pretty reasonable to me. You want AI-accelerated biological or radiological experiments running in your neighbors backyard? You want PRC-backed labs to continue to steal Anthropic's models via distillation?

Mitigating the harms of dual-use tech is notoriously difficult and fraught with trade offs. What I would want to see is cautious rollout and quick response, which is EXACTLY what they're doing.

Instead, this thread is full of bad-faith arguments about Anthropic being dishonest, making a "useless" model, or "the power is going to their heads." You can't read Anthropic's System Cards and come away with any of these impressions. Quite the opposite, in fact. They are honest to a fault, acknowledging problems they discovered even when it hurts them.

If your harmless request was downgraded to Opus, you're billed for Opus. They were 100% clear about that. I'd much rather have a Mythos-class model that falls back to Opus 10% of the time than be capped to Opus 100% of the time. If that doesn't work for you, then make a suggestion for something better!

If you are a white-hat security engineer hitting guardrails, I don't think you have standing to complain. I really don't. Their Glasswing program actually got banks and the industrial sector to take action to fix security vulnerabilities. Do you realize how special that is? A huge portion of the economy runs on vulnerable code and has for decades, despite security experts testifying to Congress, begging business leaders, pleading for intervention-- with no results. But suddenly they're all enrolled in a program that will find *and fix* vulnerabilities! White-hat security people should be rejoicing. Instead some of them are throwing rocks. Unbelievable. Shameful.

Meanwhile, society is screaming at the AI labs to be more conscientious about potential harms of AI. Legislatures are passing laws limiting data center construction. There are protests. And you, the HN community, the vanguard of our profession, have the temerity to demand "NO GUARDRAILS!" "HOW DARE YOU TRY TO PROTECT DEMOCRACY!" "MY SOFTWARE PROJECT IS MORE IMPORTANT THAN KEEPING NUKES AWAY FROM THE BAD GUYS!"

Go ahead HN, downvote me. It'd be an honor.
trunnell
·เดือนที่แล้ว·discuss
We've heard:

- It can make kids "overconfident when they see material they think they already know, so they end up not engaging."

- Some programs, particularly RSM, are criticized for valuing speed over depth. Current culture for K-8 math teachers is the opposite, they value depth over speed.

Left unsaid:

- It can make the teacher's job harder when the class has a wide span of abilities.

- Current teaching culture is skeptical of accelerating and/or skipping grades in math.

Notably, we've never heard English teachers be upset about a kid reading a book outside of school that's above grade level, or using advanced vocabulary in an essay. They tend to praise it.
trunnell
·เดือนที่แล้ว·discuss
I'm in the SF bay area w/ middle school and high school age kids.

Between San Jose and San Francisco, 15%-30% of kids are in private school (it's 30% in SF where the public schools are extra dysfunctional). That's far above the California statewide average of 8% in private school.

Among our peers, somewhere between 1/4 and 1/3 of kids are doing advanced math outside of school, typically either Russian School of Math or Art of Problem Solving. This group only partially overlaps with the private school group. This is happening despite the fact that both public and private school teachers strongly discourage math outside of school!

So by decelerating math in the public school, incentives were created for privileged parents to take matters in their own hands and put their kids into programs that accelerate math education far beyond what public schools used to do. We now have a system that is creating even wider disparities in outcomes. It stands to reason that it's producing far less equitable outcomes, too, given that extremely bright kids who happen to be in lower-resourced schools have fewer opportunities. Universal screening for giftedness, advanced public school math courses, and the SAT -- all avenues for advancement regardless of background -- were all eliminated.
trunnell
·เดือนที่แล้ว·discuss
> The people working on this aren't idiots.

Which people are you referring to?
trunnell
·5 เดือนที่ผ่านมา·discuss
How about, "tell the agent to write instructions for cloud deployment with a cost estimate"
trunnell
·7 เดือนที่ผ่านมา·discuss
That’s for future unreleased capabilities and models, not the model released today.

They did the same thing for gpt-5.1-codex-max (code name “arcticfox”), delaying its availability in the API and only allowing it to be used by monthly plan users, and as an API user I found it very annoying.
trunnell
·7 เดือนที่ผ่านมา·discuss
Why aren’t they making gpt-5.2-codex available in the API at launch?