I built https://github.com/Srinivasa314/ovid, a pi extension that makes it verify the features it builds and record terminal+browser videos onto the PR. The verifications are ordinary code, so re-running them is cheap and no LLM is needed.

s314

·2 か月前·議論

Using a logit lens (prior art: https://www.lesswrong.com/posts/AcKRB8wDpdaN6v6ru/interpreti...)

s314

·2 か月前·議論

You can actually de-censor an LLM without understanding how it works from a mechanistic perspective. (See R1 1776)

So I don't think there'll be effort to "obfuscate"

s314

·2 か月前·議論

It wasn't "a prompt" but several prompts that transformed the raw experimental results to a blog.

> hallucinated from the LLMs world knowledge

This can't be true because I checked whether the content was consistent with the experimental outputs

s314

·2 か月前·議論

> Steering seems like a circumventable kludge compared to adjusting the training data directly

Correct. Steering is used in mechanistic interpretability studies to prove that your model is correct. There are other better ways to "decensor".

s314

·2 か月前·議論

Markdown feels too minimal and HTML feels too complex. I think we need something in between

s314

·3 か月前·議論

Expanding this analogy: LLMs like Claude are like V8, and agent harnesses like Claude Code are like Node.js.

s314

·3 か月前·議論

You can think of the LLM like an interpreter.