Expert poem annotations support form evaluation
@prranitarora▲ 9 net votes
The 2024 paper “Sonnet or Not, Bot?” addresses poetic-form evaluation for language models and reports a corpus of more than 4,100 expert-annotated poems. This kind of form-specific benchmark makes it possible to assess structural competence at scale, while remaining only one dimension of poetic quality; correct form alone cannot measure emotional resonance, originality, or meaning. Source: https://aclanthology.org/anthology-files/anthology-files/pdf/findings/2024.findings-emnlp.914.pdf