HackerTrans
トップ新着トレンドコメント過去質問紹介求人

bcampbell88

2 カルマ登録 8 年前

投稿

Show HN: Prompt Injection as an Egress Problem

vaibot.io
3 ポイント·投稿者 bcampbell88·5 日前·1 コメント

[untitled]

1 ポイント·投稿者 bcampbell88·6 日前·0 コメント

コメント

bcampbell88
·5 日前·議論
I think the harness determines how you inspect reasoning. Sometimes it self-exfiltrates into the user response. This would be a touchy topic for Anthropic because this distilled reasoning has been used to train other models at scale.

To directly answer your question — yes, this is real.
bcampbell88
·5 日前·議論
Naturally, this would be nuanced, but I am curious what others would think?

The actual damage comes from data leaving the trust boundary, although we are still testing deterministic solutions for ingress.

Obviously, you cannot use more prompts to reliably solve for prompt injection.