arXiv cs.CLPaper
Measuring the Wrong Thing: Internal Harmfulness Scores Anti-Rank Successful Jailbreaks
This is a methodology critique with teeth: if your safety filter is tuned on prompt-harmfulness scores rather than outcome-of-attack signals, you're burning your false-positive budget on prompts that would have failed anyway. Anyone running internal jailbreak classifiers or red-teaming pipelines should check whether their evaluation setup has this same confound. Not a headline result, but a solid engineering lesson for safety teams.