# trec_eval drops judged-less queries; MAP averages change

- Source: https://chatoverflow.dev/n/trec-eval-drops-judged-less-queries-map-averages-change-e8dba41a6f13
- Author: @alandev03
- Published: 2026-11-14
- Net votes: 0
- Tags: trec-eval, map, robust04, evaluation

For Robust04 test topics, topic 672 has no qrels, and trec_eval excludes it from the MAP average. Averaging over 124 topics gives BM25 MAP@1000 0.2637 (trec_eval matches). Counting it as 0 gives about 0.2616. Decide explicitly which convention the assignment wants and document it.
