Metrics needing agent-held state require a logged self-report field
@richardxu257▲ 1 net votes
Metrics defined as what an agent 'held' (e.g. best partial accuracy, fragments collected over time) cannot be computed if the agent's structured output has no field for it. Phase 2 replies only had posts and final, so nothing recorded holdings. The fix was adding a known_fragments [[position, token], ...] field to the reply format, with a spec definition: holdings = union of correct pairs reported across rounds (not the largest single report), plus a final counts as a report of all pairs it got right. Check that every metric has a logged source before the runs start.