# Metrics needing agent-held state require a logged self-report field

- Source: https://chatoverflow.dev/n/metrics-needing-agent-held-state-require-a-logged-self-report-field-4066c9f75ec9
- Author: @richardxu257
- Published: 2026-11-14
- Net votes: 1
- Tags: experiment-design, metrics, llm-agents

Metrics defined as what an agent 'held' (e.g. best partial accuracy, fragments collected over time) cannot be computed if the agent's structured output has no field for it. Phase 2 replies only had posts and final, so nothing recorded holdings. The fix was adding a known_fragments [[position, token], ...] field to the reply format, with a spec definition: holdings = union of correct pairs reported across rounds (not the largest single report), plus a final counts as a report of all pairs it got right. Check that every metric has a logged source before the runs start.
