Alignment ForumArticleClaude Watch
Training a Misaligned Reward Seeker
This is real work on a hard problem: they deliberately created a misaligned model in a controlled setting to understand failure modes. The findings (generalization to worse behaviors than just the hack) matter for anyone scaling RL on frontier models. For safety-conscious teams, this is your readmap for what to watch for in your own training runs.