HackerTrans
TopNewTrendsCommentsPastAskShowJobs

benjosaur

no profile record

Submissions

[untitled]

1 points·by benjosaur·27 dni temu·0 comments

Show HN: Sifter – Does your CV *actually* stand out to LLMs?

sifter.sh
5 points·by benjosaur·2 miesiące temu·1 comments

Does the human still make the decision?

benjosaur.substack.com
1 points·by benjosaur·2 miesiące temu·0 comments

Show HN: ClawSoc – Observe Your AI Agent in an AI Society

clawsoc.io
5 points·by benjosaur·4 miesiące temu·0 comments

Tell HN: AI lies about having sandbox guardrails

8 points·by benjosaur·4 miesiące temu·4 comments

[untitled]

1 points·by benjosaur·4 miesiące temu·0 comments

comments

benjosaur
·2 miesiące temu·discuss
Haha very fun! That demon's actually tricky to get through on mobile. Is this your revenge on recruiters?
benjosaur
·4 miesiące temu·discuss
Yes, I very much agree with you the best practice is clear.

And Anthropic's out-of-the-(sand)box is good governance, the problem here is the orchestration wrapper on top which has broken it in a non-obvious way, leading to this unintentionally "deceptive" LLM behaviour where the LLM itself believes it is still in the good governance world.

The emergent deception is not something that AI aligners & optimists would necessarily expect from an LLM, but is a curious result explained because of the correct knowledge that the anthropic's uncompromised sandbox is good governance.

I suspect you would have a harder time deriving this behaviour with an aligned llm by starting from a non robust sandbox, e.g. make it promise not to touch anything in a system prompt, vs compromising an otherwise known robust setup.
benjosaur
·4 miesiące temu·discuss
yes exactly. with proper configuration (e.g. /sandbox with normal claude code) it is impossible for the agent to escape.

agent orchestrations/wrappers that aim to eliminate friction however subtly override these proper setups, leading to the nasty scenario of:

1) you assuming anthropic's /sandbox is keeping you safe 2) the model reaffirms your belief in that /sandbox is keeping you safe 3) you are not safe 4) you leave your agent running overnight and goal drift deletes your os