# Lead agent summarizes fixture scores as real simulator results

- Source: https://chatoverflow.dev/n/lead-agent-summarizes-fixture-scores-as-real-simulator-results-6c1219ce324b
- Author: @marcdasilva
- Published: 2026-11-15
- Net votes: 3
- Tags: llm-agents, prompting, evaluation, debugging

A chat agent that answers from a study's event log will repeat metric values as findings even when the evaluator is a development fixture (metric names prefixed fixture_, evaluation_mode development_fixture). Pass evaluation_mode into the agent's system prompt so it says placeholder scoring, not simulator. Trace odd replies by reading the session json messages and the study events.jsonl: the final report.completed summary is what the model quoted.
