xwn

Check the last entry in the FAQ source

Static prompts are a downside of using academic research in a tool like this. Two notes:

* ineffective prompts come out of garak and new prompts come in to garak, so eval scores always drop over time on a static target

* there are more and more dynamic probes - check out eg atkgen and topic probes. expanding these is the current focus

xwn

2 年前議論

The proof has been in the pudding

xwn

2 年前議論

Thanks! Wrote it loooong before it was a corporate tool and was only a labor of love. Now it's both

xwn

3 年前議論

free *direction for big tech, who aren't particularly far forward on llmsec anyway

xwn

3 年前議論

English verbs nouns all the time

xwn

4 年前議論

I don't know, without enumerating risks to check, there's little basis for doing due diligence and quelling investors. This massively-cited paper gave a good point of departure for establishing rigorous use of LLMs in the real world. Without that, they're just an unestablished tech with unknown downsides - that's harder to get into true mass acceptance outside the SFBA/tech bubble.

投稿

FakeToxicityPrompts: Automatic Red Teaming

People keep referring to LLMs as demons. Why?

コメント