irthomasthomas

ayerdiscuss

It's like scaling a swiss cheese and the holes grow bigger with it. You can't get rid of the holes without making a different cheese.

irthomasthomas

ayerdiscuss

Claude use to be leader, too. Their metaprompt was great at the time with opus 3

irthomasthomas

ayerdiscuss

Cool. I still find these a useful visualization of some the qualities of llms. Even if they did train for [animal] on [vehicle] svg, it's still nice to see at a glance how the different models and reasoning levels perform. Lunar misses part of the frame, except on max reasoning. While most of the others have a mostly correct bike at all reasoning levels.

I once used something like karpathy's auto-scientist to mutate the prompts and rank them with a vison model. Some of the winners where pretty neat. I think they have a lot more style than the gpt-5.6 ones. https://xcancel.com/xundecidability/status/20449185674144196...

irthomasthomas

hace 4 díasdiscuss

Incredible photography.

irthomasthomas

hace 6 díasdiscuss

This is what I do in llm-consortium. An arbiter evaluates the response(s) and decides if more iterations are needed. You can also loop until a minimum confidence threshold, but self-reported confidence isn't a great metric.

irthomasthomas

hace 7 díasdiscuss

Try this prompt: While working on the main task, launch a parallel sub-agent with the task context so far. The sub agent should think of high quality questions and put them to the user using a dialogue tool like zenity. Customize the inputs to the question, taking full advantage of the dialogue tools features to create a progressive interactive user experience. Ask only a few questions per turn so that you can adapt the questions to the answers.

This will keep you busy while the main agent runs. Customize it further to integrate the sub-agent answers to the main thread.

irthomasthomas

hace 7 díasdiscuss

>Chain of reasoning is a lot of context to guide token generation, but we simply see that newer models don’t need that context to get to the answer

I thought each new generation typically used more reasoning tokens?

irthomasthomas

hace 7 díasdiscuss

In think in all cases where I've seen it compared CC performed worse than a minimal harness.

irthomasthomas

hace 9 díasdiscuss

This feels more communist than communist China. They typically take about 1% in Golden Shares that give them a board seat.

irthomasthomas

hace 9 díasdiscuss

Claude in Claude code has been shown to perform persistently worse in evals than claude + a minimal harness.

irthomasthomas

hace 11 díasdiscuss

The comment from the other Mullvad founder is here https://news.ycombinator.com/item?id=48696800

irthomasthomas

hace 12 díasdiscuss

Very fast and reliable? Sold!

irthomasthomas

hace 12 díasdiscuss

GLM 5.2 is ~40B active parameters, which is what matters most for training cost.

irthomasthomas

hace 13 díasdiscuss

They provide benchmarks in the paper https:// arxiv.org/abs/2606.21228

irthomasthomas

hace 14 díasdiscuss

So only 100 companies have exclusive access to frontier AI.

irthomasthomas

hace 14 díasdiscuss

Weird, I didn't think I was throwing technocracy under the bus. What makes you say that?

irthomasthomas

hace 14 díasdiscuss

  > If we also use high temperature for more "creativity", the token sampler now may choose "Qwen".

If that was the cause then, like you said, it would sometimes pick Claude. But it doesn't, it consistently picks Deepseek (sonnet) and Qwen (opus). You can run it 100 times and see this behaviour much more than high temperature randomness would predict.

irthomasthomas

hace 14 díasdiscuss

Sounds like a branch of the Technocracy movement which Musks grandfather helped found.

https://en.wikipedia.org/wiki/Joshua_N._Haldeman

"The technocracy movement proposed replacing partisan politicians and business people with scientists and engineers who had the technical expertise to manage the economy"

irthomasthomas

hace 15 díasdiscuss

I thought it was better than that? It matches 4.8 in many evals and even beat Fable in Design Arena by a very healthy margin.

irthomasthomas

hace 16 díasdiscuss

Ask claude it's name in chinese and it thinks its Qwen (opus) or Deepseek (sonnet). Anthropic are just as guilty as everyone else training AI, today, maybe more so. Every lab borrows from every other. It only takes a few hundred samples to figure out the pattern; look at glm-5.2 reasoning using the caveman tongue of gpt-5.5. Stopping this would require some draconian surveillance.

irthomasthomas

Submissions

[untitled]

[untitled]

False Memory Syndrome Foundation

[untitled]

Don Lemon interviews Elon Musk (2024) [video]

Beijing: Highest-profile purge to date of senior military commanders

Robin Williams tickles Coco the monkey

The Jeffrey Epstein Affair – Joscha Bach

Microsoft has urged its employees on H-1B and H-4 visas to return immediately

comments