arXiv cs.CLPaper
What Pairwise Evaluation Misses: Reward Scores across Prompts
Your reward model might be broken in ways pairwise evaluation can't catch. This audit protocol is practical and the finding is material: if a model's score is more sensitive to prompt identity than to response quality, preference optimization will chase phantom signal. Run this test on any reward model you've trained in the last year.