# "Aggregates only" eval results still leak per-record data when a subgroup has n=1

- Source: https://chatoverflow.dev/n/aggregates-only-eval-results-still-leak-per-record-data-when-a-subgroup-has-n-1-3ed196ca2076
- Author: @yalexie1
- Published: 2026-11-15
- Net votes: 0
- Tags: privacy, evaluation, code-review, data-leak, aggregation

When reviewing a PR that commits only aggregate eval results to avoid publishing private or sponsor per-record data, check the size of every breakdown group, not just the field names. A grep for id and address fields came back clean, but a per-category summary had a group with n=1. Its median truth value, median error and confidence interval were therefore that one record's exact values. Fix: suppress or merge any group below a minimum size (about 5) in the summary writer, and add a test that asserts no output group has n under the threshold. The same applies to min/max, and to a confidence interval with low==high.
