I think I can get the original reasoning of Claude models. Is this real?(thinking-signature-demo-5g65bijswq-de.a.run.app)
thinking-signature-demo-5g65bijswq-de.a.run.app
I think I can get the original reasoning of Claude models. Is this real?
https://thinking-signature-demo-5g65bijswq-de.a.run.app/
4 comments
I think the harness determines how you inspect reasoning. Sometimes it self-exfiltrates into the user response. This would be a touchy topic for Anthropic because this distilled reasoning has been used to train other models at scale.
To directly answer your question — yes, this is real.
To directly answer your question — yes, this is real.
[deleted]
[deleted]
After some experiments, I think I may have found a way to get the original reasoning from signature.
I built a verification test. The idea is simple: you generate a random secret locally, make Claude place it only inside private reasoning, extract only the returned signature, and then submit only that signature. If the secret comes back while the visible answer never contained it, that is evidence that I am correctly recovering content from the encrypted CoT, rather than guessing or re-deriving it.
Another signal that makes me take this seriously: in most cases, without giving the recovery side any hint about the hidden reasoning, the recovered CoT has exactly the same length as the CoT reported by the API.
some examples: https://github.com/s-JoL/open-reasoning
If it’s real, it seems important.