bcampbell88

2 karmajoined 8 tahun yang lalu

Submissions

Show HN: Prompt Injection as an Egress Problem

vaibot.io

3 pointsby bcampbell885 hari yang lalu1 comments

[untitled]

1 pointsby bcampbell886 hari yang lalu0 comments

comments

bcampbell88

5 hari yang laludiscuss

I think the harness determines how you inspect reasoning. Sometimes it self-exfiltrates into the user response. This would be a touchy topic for Anthropic because this distilled reasoning has been used to train other models at scale.

To directly answer your question — yes, this is real.

bcampbell88

5 hari yang laludiscuss

Naturally, this would be nuanced, but I am curious what others would think?

The actual damage comes from data leaving the trust boundary, although we are still testing deterministic solutions for ingress.

Obviously, you cannot use more prompts to reliably solve for prompt injection.