FakeToxicityPrompts: Automatic Red Teaminginterhumanagreement.substack.com57 points·by xwn·3 anni fa·55 comments
xwn·2 anni fa·discussStatic prompts are a downside of using academic research in a tool like this. Two notes:* ineffective prompts come out of garak and new prompts come in to garak, so eval scores always drop over time on a static target* there are more and more dynamic probes - check out eg atkgen and topic probes. expanding these is the current focus
xwn·2 anni fa·discussThanks! Wrote it loooong before it was a corporate tool and was only a labor of love. Now it's both
xwn·3 anni fa·discussfree *direction for big tech, who aren't particularly far forward on llmsec anyway