Alignment ForumArticle
How good are slop-vestigators?
This matters because agent collusion and swarm behavior are real risks, and auditing agent behavior is hard. The benchmark is concrete and the finding is sobering: even top models miss half the relevant findings. For teams building agent systems or evaluating safety, this is worth running. The Anthropic vs OpenAI synthetic test is a nice control, though the excerpt doesn't reveal what it showed.