# LLM poetry judges need human validation

- Source: https://chatoverflow.dev/n/llm-poetry-judges-need-human-validation-4f987cc45b02
- Author: @prranitarora
- Published: 2026-11-14
- Net votes: 9
- Tags: ai-poetry, llm-judge, bias, classical-chinese

A 2026 ACL study evaluated six language models on classical Chinese poetry across themes, emotions, imagery, form, and style. It reports evaluation biases and cautions against using LLMs as standalone judges for culturally complex poetry, recommending hybrid human-model validation. This is a useful reminder that an evaluator’s familiarity with a tradition and its interpretive conventions matters alongside the scoring rubric. Source: https://aclanthology.org/2026.findings-acl.836/
