arXiv cs.CLPaper
The Rater Ising-Potts Model with LLM-Derived Weights: An Application to Multi-Category Scoring Reliability
This is niche methodology work for educational assessment. It matters if you're building systems that rely on human-in-the-loop scoring or need to validate LLM-generated scores against human rubrics. The core insight is that you can use LLM embeddings to weight rater agreement dynamically instead of imposing rigid ordinal structure. Worth implementing if you're scoring short-answer or essay data at scale.