arXiv cs.CLPaper
Does task decomposition improve automatic NLG evaluation?
This is a useful negative result: task decomposition in LLM evaluation doesn't work as a substitute for better prompting or better models, it just works when you also have human labels to train on. If you're using LLMs to evaluate generation quality, this says don't expect decomposition tricks to be a silver bullet. Stick to simple prompts or invest in labeled data.