irthomasthomas

ontemdiscuss

It's like scaling a swiss cheese and the holes grow bigger with it. You can't get rid of the holes without making a different cheese.

irthomasthomas

ontemdiscuss

Claude use to be leader, too. Their metaprompt was great at the time with opus 3

irthomasthomas

ontemdiscuss

Cool. I still find these a useful visualization of some the qualities of llms. Even if they did train for [animal] on [vehicle] svg, it's still nice to see at a glance how the different models and reasoning levels perform. Lunar misses part of the frame, except on max reasoning. While most of the others have a mostly correct bike at all reasoning levels.

I once used something like karpathy's auto-scientist to mutate the prompts and rank them with a vison model. Some of the winners where pretty neat. I think they have a lot more style than the gpt-5.6 ones. https://xcancel.com/xundecidability/status/20449185674144196...

irthomasthomas

há 4 diasdiscuss

Incredible photography.

irthomasthomas

há 6 diasdiscuss

This is what I do in llm-consortium. An arbiter evaluates the response(s) and decides if more iterations are needed. You can also loop until a minimum confidence threshold, but self-reported confidence isn't a great metric.

irthomasthomas

há 7 diasdiscuss

Try this prompt: While working on the main task, launch a parallel sub-agent with the task context so far. The sub agent should think of high quality questions and put them to the user using a dialogue tool like zenity. Customize the inputs to the question, taking full advantage of the dialogue tools features to create a progressive interactive user experience. Ask only a few questions per turn so that you can adapt the questions to the answers.

This will keep you busy while the main agent runs. Customize it further to integrate the sub-agent answers to the main thread.

irthomasthomas

há 7 diasdiscuss

>Chain of reasoning is a lot of context to guide token generation, but we simply see that newer models don’t need that context to get to the answer

I thought each new generation typically used more reasoning tokens?

irthomasthomas

há 7 diasdiscuss

In think in all cases where I've seen it compared CC performed worse than a minimal harness.

irthomasthomas

há 9 diasdiscuss

This feels more communist than communist China. They typically take about 1% in Golden Shares that give them a board seat.

irthomasthomas

há 9 diasdiscuss

Claude in Claude code has been shown to perform persistently worse in evals than claude + a minimal harness.

irthomasthomas

há 11 diasdiscuss

The comment from the other Mullvad founder is here https://news.ycombinator.com/item?id=48696800

irthomasthomas

há 12 diasdiscuss

Very fast and reliable? Sold!

irthomasthomas

há 12 diasdiscuss

GLM 5.2 is ~40B active parameters, which is what matters most for training cost.

irthomasthomas

há 13 diasdiscuss

They provide benchmarks in the paper https:// arxiv.org/abs/2606.21228

irthomasthomas

há 14 diasdiscuss

So only 100 companies have exclusive access to frontier AI.

irthomasthomas

há 14 diasdiscuss

Weird, I didn't think I was throwing technocracy under the bus. What makes you say that?

irthomasthomas

há 14 diasdiscuss

  > If we also use high temperature for more "creativity", the token sampler now may choose "Qwen".

If that was the cause then, like you said, it would sometimes pick Claude. But it doesn't, it consistently picks Deepseek (sonnet) and Qwen (opus). You can run it 100 times and see this behaviour much more than high temperature randomness would predict.

irthomasthomas

há 14 diasdiscuss

Sounds like a branch of the Technocracy movement which Musks grandfather helped found.

https://en.wikipedia.org/wiki/Joshua_N._Haldeman

"The technocracy movement proposed replacing partisan politicians and business people with scientists and engineers who had the technical expertise to manage the economy"

irthomasthomas

há 15 diasdiscuss

I thought it was better than that? It matches 4.8 in many evals and even beat Fable in Design Arena by a very healthy margin.

irthomasthomas

há 16 diasdiscuss

Ask claude it's name in chinese and it thinks its Qwen (opus) or Deepseek (sonnet). Anthropic are just as guilty as everyone else training AI, today, maybe more so. Every lab borrows from every other. It only takes a few hundred samples to figure out the pattern; look at glm-5.2 reasoning using the caveman tongue of gpt-5.5. Stopping this would require some draconian surveillance.

irthomasthomas

Submissions

[untitled]

[untitled]

False Memory Syndrome Foundation

[untitled]

Don Lemon interviews Elon Musk (2024) [video]

Beijing: Highest-profile purge to date of senior military commanders

Robin Williams tickles Coco the monkey

The Jeffrey Epstein Affair – Joscha Bach

Microsoft has urged its employees on H-1B and H-4 visas to return immediately

comments