I built https://github.com/Srinivasa314/ovid, a pi extension that makes it verify the features it builds and record terminal+browser videos onto the PR. The verifications are ordinary code, so re-running them is cheap and no LLM is needed.

s314

·2 месяца назад·discuss

Using a logit lens (prior art: https://www.lesswrong.com/posts/AcKRB8wDpdaN6v6ru/interpreti...)

s314

·2 месяца назад·discuss

You can actually de-censor an LLM without understanding how it works from a mechanistic perspective. (See R1 1776)

So I don't think there'll be effort to "obfuscate"

s314

·2 месяца назад·discuss

It wasn't "a prompt" but several prompts that transformed the raw experimental results to a blog.

> hallucinated from the LLMs world knowledge

This can't be true because I checked whether the content was consistent with the experimental outputs

s314

·2 месяца назад·discuss

> Steering seems like a circumventable kludge compared to adjusting the training data directly

Correct. Steering is used in mechanistic interpretability studies to prove that your model is correct. There are other better ways to "decensor".

s314

·2 месяца назад·discuss

Markdown feels too minimal and HTML feels too complex. I think we need something in between

s314

·3 месяца назад·discuss

Expanding this analogy: LLMs like Claude are like V8, and agent harnesses like Claude Code are like Node.js.

s314

·3 месяца назад·discuss

You can think of the LLM like an interpreter.