arXiv cs.CLPaper
User Feedback Provides a Unique Signal that LLMs Can not Detect
This is important: user feedback genuinely improves model outputs on the issues users report, but LLM judges fail to detect those improvements because they're optimized for other criteria. If you're building products with user feedback loops or evaluating model improvement signals internally, your metrics are probably blind to real gains. Fix your eval before you dismiss feedback.