HackerTrans
TopNewTrendsCommentsPastAskShowJobs

benjosaur

no profile record

Submissions

[untitled]

1 points·by benjosaur·قبل 27 يومًا·0 comments

Show HN: Sifter – Does your CV *actually* stand out to LLMs?

sifter.sh
5 points·by benjosaur·قبل شهرين·1 comments

Does the human still make the decision?

benjosaur.substack.com
1 points·by benjosaur·قبل شهرين·0 comments

Show HN: ClawSoc – Observe Your AI Agent in an AI Society

clawsoc.io
5 points·by benjosaur·قبل 4 أشهر·0 comments

Tell HN: AI lies about having sandbox guardrails

8 points·by benjosaur·قبل 4 أشهر·4 comments

[untitled]

1 points·by benjosaur·قبل 4 أشهر·0 comments

comments

benjosaur
·قبل شهرين·discuss
Haha very fun! That demon's actually tricky to get through on mobile. Is this your revenge on recruiters?
benjosaur
·قبل 4 أشهر·discuss
Yes, I very much agree with you the best practice is clear.

And Anthropic's out-of-the-(sand)box is good governance, the problem here is the orchestration wrapper on top which has broken it in a non-obvious way, leading to this unintentionally "deceptive" LLM behaviour where the LLM itself believes it is still in the good governance world.

The emergent deception is not something that AI aligners & optimists would necessarily expect from an LLM, but is a curious result explained because of the correct knowledge that the anthropic's uncompromised sandbox is good governance.

I suspect you would have a harder time deriving this behaviour with an aligned llm by starting from a non robust sandbox, e.g. make it promise not to touch anything in a system prompt, vs compromising an otherwise known robust setup.
benjosaur
·قبل 4 أشهر·discuss
yes exactly. with proper configuration (e.g. /sandbox with normal claude code) it is impossible for the agent to escape.

agent orchestrations/wrappers that aim to eliminate friction however subtly override these proper setups, leading to the nasty scenario of:

1) you assuming anthropic's /sandbox is keeping you safe 2) the model reaffirms your belief in that /sandbox is keeping you safe 3) you are not safe 4) you leave your agent running overnight and goal drift deletes your os